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Abstract 

One  phase  in  the  Officer  Training  School  (OTS)  selection 
process  is  meeting  a  selection  board.  Recruiting  Services  (HQ 
ATC/RS)  currently  uses  a  regression  model  (based  on  data  from  one 
board)  to  evenly  distribute  "guality"  among  the  different  panels 
in  the  selection  boards.  HQ  ATC/RS  wanted  a  method  o 1  predicting 
board  scores  based  on  data  from  multiple  boards.  This  study  used 
the  results  from  eighteen  boards  ana  9215  applicants  to  develop  and 
validate  a  multi-board  regression  model  for  each  of  five 
application  categories. 

Comparisons  between  the  two  models  showed  mixed  results.  In 
two  categories,  non-rated  operations  and  technical,  the  multi¬ 
board  model  explained  a  higher  proportion  of  the  total  variance. 
However,  in  the  other  three  categories,  the  single-board  model 
explained  significantly  more  of  the  total  variance.  In  all  but  one 
category,  the  single-board  model  had  lower  prediction  errors. 
Overall,  the  multi-board  model  was  able  to  predict  board  scores 
well  enough  to  sort  the  records  so  that  each  panel  would  get 
approximately  the  same  guality  distribution  of  records. 

A  discriminant  analysis  was  also  performed  using  the  top  331 
of  the  board  scores  to  represent  the  records  that  would  be  selected 
(the  bottom  67%  were  those  that  would  not  be  selected)  .  The 
results  showed  that  the  model  could  not  successfully  identify  the 
records  that  would  be  selected.  However,  it  did  a  much  better  job 
in  identifying  those  that  would  not  be  selected. 
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THE  DEVELOPMENT  OF  AN  OFFICER  TRAINING  SCHOOL  BOARD  SCORE 
PREDICTION  METHOD  USING  A  MULTI-BOARD  APPROACH 


I .  Introduction 


Background 

OTS  Selection  Process.  Officer  Training  School  (OTS)  is  one 
of  three  commissioning  programs  for  the  Air  Force.  Each 
commissioning  source,  Reserve  Officer  Training  School  (ROTC),  the 
Air  Force  Academy,  and  Officer  Training  School,  has  its  own 
selection  process.  Although  OTS  produces  the  smallest  number  of 
officers,  over  1,000  people  are  considered  for  entrance  in  OTS 
each  year.  The  selection  process  for  OTS  consists  of  three 
steps:  1)  initial  screening,  2)  meeting  the  selection  board,  and 

3)  final  selection.  Figure  1  illustrates  the  selection  process. 

Initial  Screening.  The  initial  screening  process 
consists  of  interviews  with  recruiters,  taking  the  Air  Force 
Officer  Qualification  Test  (AFOQT) ,  medical  evaluations,  and 
general  administrative  activities  (information-gathering).  If  a 
person  fails  to  meet  any  of  the  basic  qualifications,  he/she  may 
apply  for  a  waiver.  Once  a  person  is  found  to  be  qualified  or  a 
waiver(s)  is  granted,  the  person  will  then  proceed  to  the  next 
step  in  the  selection  process,  the  selection  board. 

According  to  Air  Training  Command/Recruiting  Services  (FQ 


ATC/RSC) ,  each  person  applying  for  OTS  may  apply  in  only  one  of 
five  categories:  pilot,  navigator,  non-rated  operations. 


technical  career  fields,  or  non-technical  career  fields. 
Selection  boards  a>~e  convened  approximately  four  times  per  year. 


Figure  1.  Selection  Process 

Each  board  consists  of  two  or  more  panels  in  each  of  the  five 
categories.  Three  colonels  sit  on  each  panel  (7:4). 

Selection  Boards.  Every  person  meeting  a  board  will 
have  a  record  with  all  of  the  pertinent  information  recorded. 
(Sec  Appendix  B  for  a  sample  record.)  First,  all  of  the  records 
will  be  sorted  by  application  category:  pilot,  navigator,  non- 
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The  number  of 


rated  operations,  technical,  or  non-technical . 
panels  in  each  category  is  determined  by  the  number  of  records  in 
that  particular  application  category. 

In  order  for  each  panel  to  receive  approximately  the  name 
distribution  of  "good",  "fair",  and  "poor"  records,  the  records 
are  "presorted"  using  a  regression  model  developed  by 
Headquarters  Air  Force  Military  Personnel  Center  (HQ  AFMPC/DPMD) . 
This  predicted  score  serves  as  a  merhod  for  rank-ordering  all  of 
the  records  in  each  application  category.  The  records  are  then 
sorted  into  stacks  of  ten.  The  top  record  would  go  to  the  first 
stack,  the  next  record  would  go  to  the  second  stack,  etc.  An 
equal  number  of  stacks  are  then  given  to  each  of  the  panels 
(7:4) .  Any  extra  stacks  are  given  arbitrarily  to  the  panels. 

I - 1 


PANEL  ! 


J  l 


Figure  2.  Board  Scoring  Procedure 

Each  colonel  will  review  a  stack  of  ten  records  and  assign  a 

Then  the  colonel  will  pass  the 


score  (0-10)  for  each  record. 


stack  to  the  next  colonel.  Once  a  stack  has  been  scored  by  all 
three  colonels,  the  total  board  score  is  calculated:  it  is 
simply  the  sum  of  the  three  scores,  so  the  maximum  possible  score 
is  a  thirty.  The  scoring  procedure  is  outlined  in  Figure  2. 

Once  the  total  board  score  has  been  calculated,  the  record 
goes  through  a  "quality  control"  step.  Two  separate  checks  are 
performed  on  each  record.  The  first  is  to  check  for  variations 
of  more  than  2.5  points  between  any  two  of  the  three  colonel's 
scores.  If  the  scores  vary  by  more  than  2.5  points,  the  record 
must  be  reevaluated.  The  second  check  involves  calculating  the 
standard  deviation  for  each  panel.  If  the  total  board  score  is 
more  than  one  standard  deviation  from  the  predicted  score,  the 
record  must  be  reevaluated.  Reevaluation  means  the  record  will 
go  back  to  the  panel  that  originally  scored  it.  If  the 
discrepancies  cannot  be  resolved  (the  colonels  stick  to  their 
original  scores),  the  board  score  will  stand.  Otherwise,  the  new 
score  will  be  used  (7:4). 

Final  Selection.  When  all  of  the  board  scores  have 
been  finalized,  the  final  selection  takes  place.  At  this  stage, 
the  Commander  of  Recruiting  Services  uses  information  on  the 
number  of  candidates  needed  in  each  category  (pilot,  navigator, 
non-rated  operations,  technical,  and  non-technical ) ,  quotas,  and 
the  board  scores  of  all  of  the  applicants  to  determine  which  of 
the  applicants  will  be  selected.  Since  a  single  high-ranking 
individual  makes  the  final  selection  decision,  it  is  impossible 
to  pinpoint  exactly  what  information  is  being  used  to  make  the 
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selection  decision.  It  would  also  be  very  difficult  to  adjust 
the  method  of  selection  at  this  level. 

Those  individuals  who  are  not  selected  on  their  first  board 
will  automatically  be  reapplied  for  the  next  board.  If  the 
applicant  fails  to  get  selected  on  the  next  board,  he/she  must 
reapply.  The  person  will  again  be  automatically  reapplied  for 
the  fourth  board  if  he/she  fails  to  be  selected  at  the  third 
board  (8) .  An  individual  may  apply  as  many  times  as  he/she 
wishes.  The  only  limitation  is  an  age  restriction.  However,  the 
person  may  also  apply  for  an  age  waiver,  if  necessary. 

The  goal  of  the  selection  process  is  to  provide  a  fair  and 
consistent  method  of  determining  which  applicants  will  go  to  OTS . 
Improvements  in  the  predicted  board  score  would  aid  this  process 
in  two  ways.  The  first  is  that  the  records  could  be  more  evenly 
distributed  throughout  the  panels  (the  guality  mix  in  each  stack 
of  ten  would  more  closely  resemble  the  quality  mix  in  any  other 
stack  of  ten) .  Currently,  ATC  uses  a  matrix  score  as  an 
indicator  of  the  quality  of  each  stack  of  ten  records.  The 
matrix  score  is  simply  the  average  predicted  score  for  that  stack 
(8) .  Inevitably,  comparisons  will  be  made  between  the  records  a 
colonel  is  scoring.  If  every  stack  contains  the  same  range  of 
"quality,"  every  colonel  will  be  making  similar  comparisons,  and 
no  records  will  be  judged  more  harshly  or  leniently  based  solely 
on  whether  the  record  was  placed  in  a  stack  of  outstanding  or 
below  average  records. 
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The  second  benefit  of  more  accurately  predicting  the  board 
scores  is  that  the  checks  and  balance  system  would  only  return  a 
record  for  rescoring  when  the  colonels'  scores  were  off  (either 
the  scores  deviated  too  much  from  each  other,  or  the  colonels 
allowed  some  personal  bias  to  affect  their  scores) .  If  the 
predicted  score  is  often  inaccurate,  records  would  needlessly  be 
sent  back  for  rescoring,  when  the  real  blame  was  on  the 
prediction  not  the  actual  board  score. 

The  current  method  of  predicting  the  board  score  is  a 
regression  based  on  the  results  of  a  single  board.  In  an  effort 
to  validate  the  model,  Recruiting  Services  used  the  results  from 
a  different  board.  They  found  that  "the  variable  weights  had 
changed"  (7:4).  The  measure  Recruiting  Services  is  currently 
using  only  reflects  the  outcomes  of  a  single  board  and  does  not 
account  for  changes  that  have  occurred  from  one  board  to  another 
or  from  one  year  to  another.  In  order  for  Recruiting  Services  to 
predict  the  next  set  of  board  scores,  they  need  a  robust  model 
which  includes  information  which  remains  constant  over  the  long 
term,  instead  of  information  that  may  be  biased  by  one  given 
year.  The  only  way  to  produce  such  a  model  is  to  develop  a 
prediction  method  using  the  results  from  several  years  and 
several  boards.  However,  since  change  is  inevitable,  the  model 
should  be  reassessed  often  using  only  the  most  recent  data  (for 
example,  from  the  last  three  to  five  years) . 
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It  was  the  objective  of  this  research  to  develop  a  method  of 
predicting  an  applicant's  board  score  based  on  the  individual's 
application  category  (pilot,  navigator,  non-rated  operations, 
technical,  or  non-technical )  using  the  results  from  many 
different  boards  (these  boards  would  also  span  several  years) . 
This  predicted  board  score  was  then  used  to  determine  the  matrix 
scores  which  may  be  used  to  aid  in  reducing  rater  bias. 

Sub-objectives .  To  complete  its  purpose,  the  study  had  to 
meet  the  following  research  objectives: 

1.  Collect  the  data  and  determine  if  other  factors  existed 
which  would  increase  a  model's  predictive  ability. 

2.  Determine  how  to  accommodate  missing  data. 

3.  Determine  the  relevant  factors  for  predicting  board 
scores . 

4.  Determine  what  methods  might  be  used  to  reduce  the  board 
score  prediction  error. 

The  literature  review,  which  follows,  addresses  some  of  the 
factors  used  to  predict  "success."  Some  of  these  factors  may 
also  be  considered  for  predicting  board  scores. 
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II .  Literature  Review 

Introduction 

It  is  the  purpose  of  this  section  to  review  the  literature 
pertinent  to  personnel  selection  processes.  The  primary  emphasis 
will  be  placed  on  the  use  of  predictor  variables  in  regression 
analysis  to  predict  "success".  The  relevance  of  certain 
variables  will  be  discussed.  Finally,  other  selection  concerns 
will  be  presented. 

"An  issue  of  major  importance  to  virtually  every  business  is 
the  ability  to  predict  a  priori  which  applicants  will  eventually 
prove  to  be  successful  employees"  (1:11).  If  the  reference  to 
the  Air  Force  as  a  "business"  can  be  excused,  an  important  point 
can  be  made  here.  Just  like  any  other  organization,  the  Air 
Force  needs  capable  people  to  perform  all  of  the  functions  within 
the  Air  Force.  The  cost  of  providing  those  people  is,  perhaps, 
more  important  now  than  ever,  due  to  the  large  cutbacks  in  the 
Air  Force  budget.  Therefore  it  is  in  the  best  interest  of  the 
Air  Force  to  hire  people  who  will  be  able  to  successfully  perform 
their  functions. 

Predictor  Variables.  Data  used  in  predicting  job  success 
takes  on  many  different  forms:  "...application  blanks, 
biographical  inventories,  interviews,  work  sample  tests,  and 
intelligence,  aptitude,  and  personality  tests"  (1:11).  Asher, 
Reilly,  and  Chao  have  shown  that  biographical  data  is  highly 
valid  in  predicting  success  (1:11).  Bretz  points  out  two  major 
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considerations  when  selecting  variables  for  a  prediction  model. 
The  first  is  the  validity  of  the  predictor.  Not  only  does  this 
mean  the  variable  actually  reports  the  information  desired,  but 
it  also  protects  an  organization  in  the  event  of  any  legal 
action.  the  second  consideration  is  the  "expected  return"  or 
utility  of  the  predictor.  A  utility  analysis  may  show  that 
although  a  certain  variable  does  an  excellent  job  in  predicting 
job  success,  it  may  be  so  expensive  to  obtain  that  any  benefit 
gained  from  using  this  variable  (versus  using  another  variable) 
is  lost  ( 1 : 11-12 ) . 

Grade  Point  Average.  One  of  the  more  popular 
prediction  variables  is  grade  point  average  (GPA) .  This 
popularity  may  be  based  largely  on  the  accessibil ity  of  those 
records  and  the  ease  of  using  numbers  in  regression  analysis. 
Bretz  looked  at  thirty-nine  studies  which  used  GPA  as  a  predictor 
for  some  type  of  adult  achievement.  The  results  were  very  mixed. 
Not  only  were  the  correlations  between  GPA  and  adult  achievement 
different  in  magnitude,  many  were  also  different  in  sign.  Eight 
of  the  studies  showed  a  negative  relationship  between  GPA  and 
adult  achievement  (1:13). 

Further  studies  predicting  job  success  from  GPA  were 
conducted  using  meta-analysis  (a  conglomerate  method  of 
analysis) .  The  results  indicated  that  there  might  be  some 
limited  cases  where  GPA  did  add  predictive  power.  How e\  r,  Bretz 
maintained  that  there  are  better  predictors  of  success, 
regardless  of  how  success  is  measured.  He  also  poincs  our 
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several  factors  that  are  not  included  in  GPA :  difficulty  of 
academic  program/ individual  classes  and  extracurricular 
activities.  One  additional  comment  was  that  although  general 
intelligence  has  been  shown  to  be  a  good  predictor  of  job 
success,  GPA  is  not  a  measure  of  intelligence  (1:10). 

Several  other  studies  indicate  that  at  least  one  of  those 
"other  factors"  can  be  compensated  for:  the  educational  quality 
of  the  school.  Senger  maintains  that  there  can  be  vast 
differences  in  the  general  educational  quality  of  a  highly 
competitive  technical  school  (MIT,  for  example)  versus  a 
community  college.  Additionally,  the  same  GPA  from  the  highly 
accredited  technical  school  should  be  worth  much  more  than  from 
the  community  college  (11:13).  In  a  study  predicting  academic 
success  in  a  graduate  program,  Spangler  used  the  Baron  School 
Index  ( BSI ,  a  measure  of  the  "degree  of  admissions 
competitiveness"  of  different  undergraduate  institutions)  to 
scale  GPA's.  His  results  showed  that  this  conglomerate  variable 
(GPA  *  BSI)  did  an  excellent  job  of  predicting  graduate-level 
success.  In  fact,  the  addition  of  the  admissions  competitive 
rate  for  the  institution  increased  the  correlation  between 
undergraduate  GPA  and  graduate  GPA  by  almost  twofold  (13:24,48- 
49)  . 

Training/ Experience .  Bretz  and  Giffon  discuss  the  wide 
use  of  training  and  experience  in  predicting  job  performance 
(1:19;  3:131).  In  fact,  Tenopyr  and  Oeltjen  maintain 
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that  almost  all  organizations  that  conduct  job  performance 
predictions  use  training  and/or  experience  factors  (14:289). 

Giffon  elaborates  on  four  different  methods  used  for 
quantifying  training  and  experience:  1)  the  point  method,  2) 
the  grouping  method,  3)  the  task  method,  and  4)  the  knowledge, 
skills,  abilities  (KSA)  method.  The  point  method  of  measuring 
training/experience  assigns  a  basic  score  if  a  person  meets  the 
minimum  reguirements .  For  every  increment  of  units  (month,  year, 
course  hour,  etc.)  of  training  or  experience  over  that  minimum 
the  person  receives  points.  The  grouping  method  groups 
applicants  based  on  their  "relative  gualif ications"  and  assigns 
that  same  score  for  all  people  in  a  given  group  (so  the  same 
score  will  be  given  to  those  at  the  same  level  of  qualification) . 
The  task  method  reguires  each  individual  to  assess  his/her  own 
"level  of  expertise"  on  each  of  a  list  of  tasks.  The  ratings 
could  reflect  the  amount  of  experience  in  time  or  the  amount  of 
training  required  before  the  person  could  perform  the  task. 
Finally,  the  KSA  method  uses  a  list  of  job  elements.  Each 
applicant  is  rated  based  on  their  knowledge,  skills,  abilities, 
and  other  characteristics  which  relate  specifically  to  each  job 
element  (3:131) . 

Interview.  According  to  N.  Schmitt,  "Reviews  of  the 
employment  interview  research  have  generally  come  to  the 
conclusion  that  employment  interviews  (at  least  as  they  are 
commonly  practiced  in  industry  and  government)  lack  both  validity 
and  reliability"  (3:130).  Smart  discusses  methods  for  improving 
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the  interview  process  including  the  expansion  of  "person 
specifications."  These  specifications  are  requirements  that  must 
be  met  for  any  person  to  be  successful  in  a  given  job.  Smart 
suggests  that  the  list  should  include  twenty  to  forty  different 
person  specifications.  In  general,  he  recommends  gathering  as 
much  information  about  an  applicant  as  possible  (12:47).  The 
problem  is  then  one  of  quantifying  the  results  and  implementing 
such  a  system.  As  suggested  by  the  different  methods  of 
measuring  training  and  experience,  there  are  many  potential  ways 
to  quantify  the  results.  The  real  problem  would  be  convincing 
employers  (or  the  Air  Force)  to  use  improved  interview  methods 
(3 : 130)  . 

Cognitive  Ability  Tests.  Cognitive  ability  tests 
"...are  professionally  developed  objective  tests  of  cognitive 
skills,  that  is,  aptitude  or  ability  tests.  Examples  include 
tests  of  verbal  and  quantitative  ability,  reasoning,  spatial  and 
mechanical  ability"  (4:77).  Research  shows  that  although 
cognitive  ability  tests  are  valid  predictors  of  job  performance, 
tests  are  not  predictive  of  all  jobs.  Furthermore,  as  the 
complexity  of  the  task  increases,  the  validity  of  the  cognitive 
ability  tests  increase  (4:78). 

Smith  and  Hunter  conducted  a  study  in  1981  in  which  they 
concluded  that  1)  cognitive  ability  tests  are  valid  predictors 
for  all  jobs,  2)  cognitive  ability  tests  are  "...fair  for  ethnic 
minorities  in  that  they  do  not  underestimate  the  expected  job 
performance  of  minority  group  members,"  and  3)  large  labor  cost 
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savings  could  be  realized  through  the  use  of  cognitive  ability 
tests  for  employee  selection  (4:77). 

Assessment  Centers. 

Assessment  centers  vary  dramatically  but  typically 
have  in  common  that  applicants  participate  in  a  variety 
of  activities,  at  least  some  of  which  are  group 
activities,  and  are  scored  by  a  panel  of  assessors  who 
have  been  trained  in  the  evaluation  techniques  to  be 
used.  Common  assessment  center  exercises  include 
leaderless  group  discussions,  preparation  and  giving  of 
a  press  briefing,  and  in-basket  exercises  (in  which 
applicants  are  asked  to  go  through  paperwork  typical  to 
the  job,  and  take  the  necessary  follow-up  actions) 

(3:132). 

In  addition  to  predicting  managerial  performance,  assessment 
centers  have  been  used  by  See  Bray  and  Campbell  to  predict 
leadership  in  the  military  (3:132). 

Other  Selection  Concerns.  Selecting  people  to  fill 
positions  is  a  very  challenging  task.  The  difficult  part  is 
trying  to  identify  what  variables  give  the  best  indication  that 
given  person  will  be  able  to  satisfactorily  perform  the 
function (s)  that  are  required  elements  of  the  position.  One  of 
the  biggest  challenges  in  the  selection  process  is  the  number  of 
different  types  of  positions  and  different  people,  each  with 
their  own  array  of  characteristics.  For  years,  researchers 
concluded  that  each  situation  had  to  be  dealt  with  individually, 
creating  the  need  for  different  "screening"  procedures  and 
"validation  studies"  for  every  situation  (4:76). 

McDaniel  and  Schmidt  explain  how  the  "situational  specific- 

mode  of  conducting  personnel  selections  ended. 

The  application  of  improved  methods  for  cumulating 
research  across  studies  demonstrated  that  the  perceived 


situational  specificity  of  selection  procedures  was 
illusory  and  due  to  random  sampling  error.  The 
underlying  reality  was  that  most  personnel  selection 
procedures  were  effective  methods  of  identifying 
productive  employees,  and  that  their  effectiveness  was 
essentially  constant  across  organizational  settings 
(4:76). 

Since  many  different  methods  used  for  personnel  selection 
appeared  to  be  working,  analysts  came  up  with  the  idea  of 
combining  several  methods  into  one,  in  the  hopes  that  this  multi¬ 
faceted  personnel  selection  method  would  do  an  even  better  job. 

In  1976,  Glass  created  his  own  group  of  such  methods  and  named 
this  new  conglomerate  approach  "meta-analysis" .  McDaniel  and 
Schmidt  also  credit  a  number  of  other  researchers  who  have  made 
progress  in  this  field.  One  particular  meta-analysis  method 
developed  by  Schmidt  and  Hunter  deals  specifically  with  the 
variation  in  results.  Their  model 

...determines  the  variation  attributable  to  sampling 
error  and  to  differences  between  studies  in  reliability 
and  range  restriction,  and  subtracts  that  amount  from 
the  total  amount  of  variation,  yielding  an  estimate  of 
the  true  variation  across  studies.  The  mean  levels  of 
reliability  and  range  restriction  are  used  to  correct 
the  mean  observed  correlation  to  estimate  the  true 
(population)  average  correlation  (4:77). 

The  problem  associated  with  variables  that  are  restricted  in 
range  can  be  a  very  serious  one.  A  study  conducted  by  Buckley 
sought  to  "evaluate  the  suitability"  of  variables  used  in  the 
selection  of  graduate  students  for  the  Air  Force  Institute  of 
Technology  (AFIT) .  Unfortunately ,  the  only  individuals  contained 
in  the  database  were  those  who  had  actually  been  selected  to 
attend  AFIT.  As  a  result,  the  undergraduate  GPA's,  Graduate 
Record  Examination  (GRE)  scores,  and  other  various  test  results 
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would  ba  contained  in  a  much  smaller  range  than  the  range  for  all 

applicants  (2:24). 

Summary 

In  the  development  of  selection  processes,  two  variables 
make  excellent  predictors:  experience/training  and  results  from 
cognitive  ability  tests.  GPA,  interviews,  and  assessment  centers 
also  have  some  limited  potential.  Since  the  data  available  for 
study  in  certain  situations  may  likely  contain  only  information 
relevant  to  the  individuals  in  that  group,  care  must  be  taken  to 
assure  that  the  proper  corrections  are  made  to  counter  the 
effects  due  to  any  restriction  in  range. 

In  a  survey  of  450  managers,  the  managers  estimated  the  cost 
of  " . . . mishiring  a  $30 , 000-per-year  employee  to  be  around 
$75,000"  (12:46).  Hunter  and  Schmidt  conservatively  estimated  an 
increase  in  the  gross  national  product  of  80  to  100  billion 
dollars  annually  if  improved  selection  procedures  were 
implemented  throughout  the  economy  (4:79).  Imagine  the  impacts 
on  the  economy  if  the  Air  Force  could  implement  some  improved 
selection  procedures. 
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III. 


Data 

The  data  used  in  this  analysis  is  a  portion  of  a  database 
kept  at  HQ  ATC/Recruiting  Service^.  Included  are  axl  people  who 
applied  to  OTS  and  actually  met  the  selection  board  at  least  once 
(a  total  of  9215  people  from  the  8703  board  to  the  8905  board) . 
Each  record  in  the  database  includes  biographical  information, 
test  scores,  school  information,  and  other  information  for  each 
applicant.  (A  database  description  is  included  in  Appendix  A.) 

Any  applicant  who  fails  to  be  selected  may  reapply  (in  fact, 
the  person  will  automatically  be  reapplied  the  second  time) .  As 
a  result,  many  of  the  applicants  have  multiple  board  records. 

This  analysis  uses  only  the  results  from  the  last  board  each 
person  meets.  The  reason  for  this  is  that  some  of  the 
information  is  kept  for  each  board  (the  GPA  and  highest  degree 
awarded) ,  but  most  of  the  information  is  just  updated  for 
subsequent  boards.  If  the  database  is  maintained  properly  and 
the  updates  are  indeed  entered  in  the  database  (which  is  an 
assumption  that  has  to  be  made) ,  then  only  the  most  current 
information  would  be  contained  in  the  database.  Therefore  the 
information  would  apply  to  the  last  board  the  individual  met. 

Variable  Selection 

The  first  step  in  identifying  factors  which  might  play  a 
role  in  the  board  score  was  to  look  at  an  actual  record.  (A 
sample  record  can  be  found  in  the  Appendix  B.)  The  next  step  was 
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to  look  at  the  ATC/Recruiting  Services  data  base  and  determine 
which  elements  of  information  that  are  contained  in  the 


individual's  record  are  also  captured  in  the  database.  Twenty 
seven  variables  could  be  extracted  from  the  database. 

There  were  also  many  items  of  information  that  are  included 
in  the  records,  but  either  are  not  contained  in  the  database  or 
cannot  be  captured  in  the  database.  Table  1  lists  all  items  that 
appear  in  the  actual  record  that  is  seen  by  the  board,  but  are 
not  included  in  the  database  (or  this  analysis)  . 


TABLE  1 

RECORD  INFORMATION  NOT  INCLUDED  IN  THE  DATABASE 


NEW  DATABASE  VARIABLES 

Number  of  times  applied  to  commissioning  program 
Violations  of  civil  or  military  law 
Sexual  preference 
Schools  attended 

Positions  in  school  organizations 

Scholarships 

Athletic  participation 

Hours  worked  weekly  to  defray  school  costs 
Attendance  at  industrial/trade  schools  (duration) 

Height  and  weight 

All  GPA's  (not  just  the  most  current) 

OTHER  RECORD  INFORMATION 

Geographic  region  (home  address) 

Actual  major 
Employment  record 
Additional  comments 
School  honors 

Statement  of  objective  and  reasons  for  desiring  an  AF  commission 

Pilot  questionnaire 
Resume 

Flight  time  worksheet 
Transcripts 
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The  variables  are  divided  into  those  variables  that  could 
(should)  be  included  in  the  database  in  some  form,  and  those  that 
cannot  be  captured.  An  important  point  to  note  is  that  all  of 
the  information  listed  in  Table  1  is  not  taken  into  account  in 
this  analysis. 

Variables  such  as  GPA,  AFOQT  scores,  years  of  prior  service, 
etc.,  require  no  translation  because  the  variables  are  already 
expressed  in  a  meaningful  numeric  form.  Table  2  shows  these 
variables  that  were  directly  converted  to  numeric  variables. 

TABLE  2 

NUMERIC  VARIABLES  USED  IN  ANALYSIS 


VARIABLE  DESCRIPTION 


AFLYHRS 

AFOQT_A 

AFOQT_N 

AFOQT_P 

AFOQT_Q 

AFOQT_V 

APRYRS 

EVAL1145 

GPA 

GRADE 

LORS_COL 

LORS_GEN 

LORS_TOT 

WAIVS 


Number  of  flying  hours 


Air 

Force 

Officer 

II 

II 

It 

It 

II 

II 

II 

II 

II 

II 

II 

II 

Qualifying  Test 

ii  it 

ii  ii 

ii  ii 

ii  ii 


Academic 

Navigator 

Pilot 

Quantitative 

Verbal 


Number  of  prior  service  years 
Recruiter  evaluation 
GPA  for  highest  level  of  education 
Highest  grade  attained  in  prior  service 
(0,  if  non-prior  service) 

Number  of  letters  of  recommendation  from  a  colonel 
Number  of  letters  of  recommendation  from  a  general 
Number  of  other  letters  of  recommendation 
Number  of  waivers  (not  including  age  waivers) 


However,  in  other  cases  (marital  status,  whether  or  not  the 
person  has  a  private  pilot's  license,  whether  or  not  the  person 
has  taken  calculus,  etc.)  some  translation  must  be  made.  The 
status  of  such  yes/no  variables  can  be  represented  by  0  or  1. 
Note  that  it  does  matter  which  response  is  assigned  the  "1".  In 
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the  case  of  the  APR  variable,  those  who  were  not  prior  enlisted 
should  not  be  punished  for  not  getting  all  9's  on  their  last 
three  Airman  Performance  Reports  (APR's).  Therefore  the  question 
would  be  if  those  who  were  prior  service  and  did  not  get  all  9's 
would  be  helped  or  more  likely  hurt  in  their  board  scores.  The 
DISENRL  variable  works  the  same  way:  only  those  who  had  been 
disenrolled  from  a  commissioning  program  would  be  tagged  for 
testing.  The  MARSTAT,  MINOR,  and  SX  variables  have  all  been 
designed  to  test  whether  or  not  being  married,  being  a  minority, 
or  being  a  female  helps  or  hurts  the  persons  board  score.  Since 
the  type  of  degree  is  given,  it  would  seem  appropriate  to  include 
some  aspect  of  its  relevance  to  the  individual's  application 
category.  However,  it  would  be  very  difficult  to  break  down  the 
degree  categories  too  much  because  even  the  application 
categories  are  very  broad  (especially  the  technical  and  non¬ 
technical  career  fields) .  Therefore  the  degrees  were  simply 
categorized  as  technical  or  not.  Then  the  test  can  be  made  for 
whether  or  not  having  a  technical  degree  helps/hurts  the  person's 
board  score  in  each  of  the  categories.  In  all  other  indicator 
variables,  the  test  is  whether  or  not  each  of  the  characterist ics 
captured  in  the  variables  helps  or  hurts  the  board  score.  Table 
3  shows  those  variables  that  were  more  accurately  represented  by 
indicator  variables. 
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TABLE  3 


INDICATOR  VARIABLES  USED  IN  ANALYSIS 

VARIABLE 

DESCRIPTION 

VALUE 

AGEWAIV 

Did  the  person  have  any  waivers? 

yes-1 
no  -0 

APR 

Did  the  person  have  all  9's  on  their 
last  three  APR's? 

yes-0 
no  -0 

BACH 

Did  the  person  have  at  least  a  bachelor's 
degree? 

yes-l 
no  -0 

BACHPLUS 

Did  the  person  have  more  than  a 
bachelor's  degree? 

yes-l 
no  -0 

CALC 

Did  the  person  take  calculus? 

yes-l 
no  -0 

DISENRL 

Was  the  person  ever  disenrolled  from  a 
commissioning  program? 

yes-l 
no  -0 

MARS TAT 

Is  the  person  married? 

yes-l 
no  -0 

MINOR 

Is  the  person  a  minority? 

yes-l 
no  -0 

NOBACH 

Did  the  person  have  something  short  of  a 
bachelor's  degree? 

yes-l 
no  -0 

PRIOR 

Did  the  person  have  prior  service  time? 

yes-l 
no  -0 

PRIVLIC 

Did  the  person  have  a  private  pilot's 
license? 

yes-l 
no  -0 

SX 

Is  the  person  a  female? 

yes-l 
no  -0 

T 

Did  the  person  have  a  technical  degree? 

yes-l 
no  -0 

Missing  Data 

In  several  instances,  the  data  base  only  included  responses 
if  they  were  applicable.  For  example,  the  variable  APR  (all  9's 
on  the  last  three  APR's)  only  contained  an  answer  if  the  person 
was  prior  service,  otherwise  the  variable  was  left  blank.  Using 
this  logic,  an  assumption  was  made  for  a  number  of  variables:  if 
the  data  was  missing,  then  the  person  was  assumed  not  to  have  the 


characteristic  in  guestion.  The  justification  for  such  an 


20 


assumption  is  simple.  If  the  person  in  question  did  have  some 
outstanding  characteristic,  the  individual  would  be  certain  to 
have  it  included  in  his/her  record.  By  the  same  reasoning,  if 
there  were  some  negative  characteristic  (like  being  eliminated 
from  a  commissioning  program) ,  the  Air  Force  would  be  sure  to 
include  it.  The  only  drawback  of  this  assumption  is  that  perfe  . 
information  is  assumed. 

Although  this  assumption  may  seem  like  a  big  one,  it  really 
only  assumes  that  the  people  involved  in  information  gathering 
are  ensuring  that  all  relevant  information  is  collected  and  those 
who  deal  with  the  database  are  keeping  it  up  to  date. 
Additionally,  there  were  so  many  variables  where  this  assumption 
had  to  be  applied,  that  there  would  have  been  very  few  variables 
(and  records)  to  study  if  the  assumption  had  not  been  made. 

Table  4  lists  variables,  the  possible  values  for  the  variables, 
and  the  value  assigned  to  missing  data. 

Regression  Analysis 

The  Statistical  Analysis  System  (SAS) ,  which  is  a 
statistical  software  package,  has  developed  numerous  procedures 
which  perform  regression  analysis.  Several  of  these  procedures 
have  been  used  to  select  significant  variables  (PROC  STEPWISE), 
run  regression  analysis  (PROC  REG),  produce  graphs  (PROC  PLOT), 
and  perform  statistical  analysis  (PROC  FREQ  and  PROC  MEANS) 
(10:401-774;  9:655-1005). 


21 


TABLE  4 


VARIABLES  AND  MISSING  DATA 


VARIABLE 

VARIABLE  RANGES 

MISSING  VALUES 

AFLYHRS 

0-4000 

0 

AFOQT  A 

0-100 

- 

AFOQT  N 

0-100 

- 

AFOQT  P 

0-100 

- 

AFOQT  Q 

0-100 

- 

AFOQT  V 

0-100 

- 

AGEWAIV 

0-2 

0 

APR 

Y/N 

Y 

APRYRS 

0-16 

0 

BACH 

Y/N 

- 

BACHPLUS 

Y/N 

- 

CALC 

Y/N 

- 

DISENRL 

Y/N 

N 

EVAL1145 

0-5 

0 

GPA 

0-4 . 0 

- 

GRADE 

3-7 

0 

LORS  COL 

0-5 

0 

LORS  GEN 

0-6 

0 

LORS  TOT 

0-9 

0 

MARSTAT 

Y/N 

- 

MINOR 

Y/N 

N 

NOBACH 

Y/N 

- 

PRIOR 

Y/N 

- 

PRIVLIC 

Y/N 

- 

SX 

Y/N 

- 

T 

Y/N 

- 

WAIVS 

Y/N 

0 

Normal  Error  Model.  Regression  analysis  employs  the  use  of 
the  normal  error  model.  Several  assumptions  must  be  made  in 
order  to  use  this  particular  model:  1)  the  regression  function 
must  be  linear,  2)  error  terms  have  constant  variance,  3)  the 
observations  are  independent,  and  4)  the  error  terms  are  normally 
distributed  (5:111).  These  assumptions  may  be  tested  using  lack 
of  fit  tests,  residual  plots,  and  Q-Q  plots  (ordered  residual 
versus  residual  ranking) . 
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The  first  analytical  technique  used  was  regression  analysis. 
The  purpose  was  to  determine  which  of  the  variables  discussed  in 
the  previous  section  were  significant  in  predicting  individuals' 
board  scores  and  how  good  those  predictions  were. 

In  general,  linear  regression  estimates  the  desired 
variable,  Y,  using  a  linear  combination  of  all  of  the  predictor 
variables . 


^predicted  ^0  +  b1X1  +  b2X2  +  ... 

The  linear  combination  must  minimize  the  sum  of  squares  of  the 
error:  S  (Yactual  -  Ypredjcted) 2. 

R-Square.  R-square,  the  coefficient  of  determination,  is  a 


measure  of  what  proportion  of  the  total  sum  of  squares  is  being 

explained  by  the  regression  function: 

R2  =  SSR  SSR:  Sum  of  squares  regression 

SSTO  SSTO:  Sum  of  squares  total  (5:422). 

Adjusted  R-square  (coefficient  of  multiple  determination)  is  a 

very  similar  measure,  except  it  takes  into  account  the  number  of 

parameters  being  estimated  by  the  model : 

adj  R2  =  1  -  _ MSE _  MSE:  Mean  square  error 

SSTO/(n  -  1)  SSTO:  Sum  of  Squares  total 

n:  Number  of  observations 

(5:423-424) 


Although  R-square  and  adjusted  R-square  values  are  a  very 
convenient  way  to  measure  the  explanatory  capability  of  the 
model,  they  are  not  the  only  way  to  judge  a  model.  Other  factors 
like  goodness  of  fit  and  prediction  error  may  be  even  more 
important . 
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Significance  and  Lack  of  Fit  Tests.  Several  tests  can  be 
performed  to  test  both  the  significance  of  individual  variables 
and  the  appropriateness  of  the  linear  model.  The  first  is  called 
a  student  t  test.  This  is  a  test  of  the  significance  of  each  of 
the  variables  used  in  the  model.  The  hypothesis  is  that  the 
coefficient  of  a  variable  is  equal  to  zero  (the  variable  is  not 
significant)  unless  the  t-statistic  is  greater  than  a  certain 
threshold.  The  t-statistic  is  computed  from  the  following 
equation: 

t  =  _bk  bk:  estimated  coefficient  for  Xk 

s(bk)  s(bk):  standard  error  of  bk  (5:278). 

The  partial  F  test  is  similar  in  that  it  tests  the  significance 

of  the  individual  coefficients.  However,  there  is  a  notable 

difference  in  the  approach  used.  The  t  test  assumes  that  all 

other  variables  are  included  in  the  model  and  the  "marginal 

significance"  of  the  variable  in  question  is  tested.  This 

process  is  repeated  until  all  variables  have  been  tested.  The 

partial  F  test  is  used  in  a  step  wise  approach.  The  significance 

of  the  first  variable  is  tested.  If  that  variable  is  significant 

(SAS  uses  a  .15  significance  level),  the  variable  is  retained  in 

the  model.  Then  the  next  variable  is  tested,  and  if  it  is 

significant  it  is  added  to  the  other  variables  already  in  the 

model.  This  process  continues  until  all  variables  have  been 

tested.  The  end  result  is  a  model  with  only  those  variables  that 

add  sufficient  explanatory  power  to  the  model.  The  partial  F- 

statistic  is  calculated  using  the  sum  of  squares  error  for  a  full 

model  (which  includes  the  variable  being  tested)  and  a  sum  of 
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squares  error  for  a  reduced  model  (which  includes  all  variables 
in  the  model  up  to  that  point,  except  for  the  variable  being 
tested) : 

F  =  XSSEreduCed-  -  SSEfull)-  /-  (dfreduced^_dffuUl 

MSEfUU 

SSE:  Sum  of  squares  error 

df:  Degrees  of  freedom 

MSE:  Mean  square  error  (5:280). 

The  overall  F  test  deals  with  the  principle  of  lack  of  fit. 
the  test  is  whether  or  not  the  linear  model  (regression  function) 
does  an  adequate  job  of  fitting  the  data.  Three  assumptions  are 
made  for  this  test:  the  observations  must  be  1)  independent,  2) 
normally  distributed,  and  3)  their  distributions  must  have  the 
same  variance  (5:123).  The  hypothesis  being  tested  here  is  that 
all  of  the  variable  coefficients  (B's)  are  equal  to  zero.  If  the 
F-statistic  is  above  a  certain  level,  then  this  hypothesis  may  be 
rejected  (which  means  that  the  model  does  adequately  fit  the 
data) .  The  F-statistic  is  calculated  according  to  the  following 
equation: 

F  =  MSR  MSR:  Mean  square  regression 

MSE  MSE:  Mean  square  error  (5:131). 

Model  Development.  In  order  to  perform  the  analysis,  the 
records  were  first  sorted  by  application  category.  The  following 
set  of  procedures  was  used  for  each  of  the  five  categories  (there 
were  five  separate  models) .  The  first  step  in  the  regression 
analysis  was  to  determine  which  of  the  27  variables  added 
explanatory  power  to  the  regression  model.  The  STEPWISE 
procedure  was  used  for  this  purpose.  Any  variable  having  a 
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significance  level  of  .15  or  higher  in  the  partial  F  test  was 
included  in  the  model.  The  next  step  was  to  run  the  regression 
with  those  variables.  Using  the  t-statistic,  variables  not 
meeting  the  .15  significance  level  were  removed,  one  at  a  time. 

Next,  several  tests  were  run  to  ensure  compliance  with  the 
assumptions  of  a  normal  error  model.  The  overall  F-statistic  was 
noted  at  this  time  (if  the  F-statistics  had  shown  that  models 
failed  the  lack  of  fit  test,  the  assumption  of  a  linear  model 
would  have  had  to  be  reassessed) .  In  addition,  a  Q-Q  plot  was 
generated  to  ensure  normal  distribution  of  the  error  terms. 

Plots  of  residuals  were  used  to  ensure  the  constant  variance  and 
independence  of  the  error  terms.  Finally,  the  regression  results 
were  compared  to  the  regression  results  from  a  study  conducted  by 
the  Military  Personnel  Center  (MPC) .  That  study  used  the  data 
from  a  single  board  to  predict  board  scores  for  other  boards. 

Discriminant  Analysis 

The  SAS  procedure  DISCRIM  uses  calibration  data  to  develop  a 
quadratic  discriminant  function.  This  function  can  then  be  used 
to  classify  test  data.  Since  the  applicant  selection  rate  was 
approximately  33%,  the  top  33%  of  the  board  scores  will  represent 
group  I.  This  will  serve  as  a  surrogate  for  selection.  In  each 
of  the  categories  a  slightly  different  percentage  of  the 
applicants  will  be  classified  in  group  I.  This  results  from  the 
fact  that  the  board  score  is  a  discrete  variable. 

One  of  the  assumptions  for  discriminant  analysis  is  that  the 
data  must  be  multivariate  normal.  Therefore,  the  data  used  in 
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this  analysis  consists  only  of  variables  with  at  least  some  range 
of  numerical  values.  For  this  reason,  several  indicator 
variables  could  not  be  included  even  though  they  had  statistical 
significance  in  the  regression  models. 

The  SAS  procedure  STEPDISC  performs  the  same  function  for 
discriminant  analysis  that  STEPWISE  does  for  linear  regression. 
The  significance  level  used  for  retaining  variables  was  again 
.15.  The  STEPDISC  procedure  was  run  for  each  of  the  five 
categories,  then  DISCRIM  was  used  to  accomplish  an  in  depth 
discriminant  analysis  for  each  of  the  categories. 

A  test  of  the  homogeneity  of  the  within  covariance  matrices 
was  conducted  using  the  null  hypothesis  that  there  was  no 
significant  difference  between  the  two  matrices.  If  the  test 
statistic  (a  chi-square  value)  was  high  enough,  then  the 
hypothesis  would  be  rejected  and  the  within  covariance  matrices 
would  be  used  instead  of  a  pooled  covariance  matrix. 

A  board  score  of  25  was  the  cut-off  for  group  I  for  the 
pilot  category.  The  navigator,  technical,  ana  non-technical 
used  a  score  of  24,  and  non-rated  operations  used  a  score  of  23. 
These  board  scores  were  used  because  they  created  pools  of  people 
that  were  approximately  33%  of  their  respective  categories. 
Therefore,  all  of  the  group  I's  made  up  approximately  33%  of  the 
total  individuals  in  their  respective  categories.  In  order  to 
account  for  the  varying  percentage  of  applicants  in  group  I  in 
each  of  the  application  categories,  the  proportional  priors  were 
used.  (Table  5  shows  the  cutoffs  for  the  board  scores  in  group  I 
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and  relevant  frequency 

board  score  frequencies 

information.  Appendix  C  contains 

•  ) 

TABLE  5 

GROUP  I  STATISTICS 

all 

Cateqory 

Board  Score1 

Frequency2 

Percent3 

Pilot 

25 

685 

29 . 3 

Navigator 

24 

379 

31.1 

Non-rated  operations 

23 

530 

32.7 

Technical 

24 

193 

33.9 

Non-technical 

24 

684 

27 . 0 

Lowest  board  score  in  group  I 

2  Number  of  records  in  group  I 

3  Percent  of  all  records  in  group  I  in  each  category 


To  validate  the  discriminant  function,  records  with  a  SSAN 
ending  in  9  were  not  included  in  the  calibration  data.  These 
records  from  all  five  application  categories  are  then  classified 
according  to  their  respective  discriminant  functions  and  the 
results  are  compared  with  their  "true  classifications." 
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IV.  Results 


Regression  Analysis 

Variables .  The  variables  used  in  the  MPC  model  are  very 
similar  to  the  ones  used  in  this  study.  However,  the  programming 
variable  (indicates  whether  or  not  the  person  has  taken  any 
computer  courses)  could  not  be  used  because  the  information  did 
not  exist  in  the  database.  Additionally,  the  old  model  used  BACH 
and  MAST  for  bachelor's  and  master's  degrees.  A  preliminary  test 
indicated  that  having  a  PhD  or  masters  was  not  as  important  as 
distinguishing  between  having  just  a  bachelor's  degree  or  having 
additional  education  beyond  a  bachelor's  degree.  The  current 
model  includes  the  variables  BACH  (which  does  mean  the  same  as 
the  MPC  model)  and  BACIIPLUS  (which  does  not  necessarily  mean  a 
masters,  but  it  does  indicate  that  the  person  has  more  than  just 
a  bachelor's  degree). 

Pilot .  In  the  Pilot  regression,  there  were  some  very 
strong  similarities  in  model  variables  between  the  MPC  model  and 
the  multi-board  model  run  here.  Both  included  GPA ,  AFOQT_P ,  and 
AFOQT_A .  However,  the  new  multi-board  model  also  included  SX 
(being  female)  and  PRIVLIC  (having  a  private  pilot's  license)  as 
main  positive  factors.  It  is  interesting  that  having  a 
bachelor's  degree  was  a  negative  factor  in  the  MPC  model,  wh i 1 e 
having  more  than  a  bachelors  was  a  definite  positive  in  the  new 
model.  One  variable  in  the  new  model  did  not  have  the  expected 
sign.  APRYRS  is  the  number  of  prior  enlisted  years  served. 
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Since  pilots  are  very  expensive  to  train,  and  the  goal  is  to  keep 
them  around  as  long  as  possible,  once  the  money  has  been  spent  to 
train  them,  they  should  be  kept  as  long  as  possible.  After  some 
consideration,  it  seems  likely  that  those  individuals  who  already 
have  some  time  in  would  already  have  made  the  commitment  to  stay 
for  twenty  years  before  entering  pilot  training.  Those  who  enter 
pilot  training  without  any  prior  time,  might  choose  to  get  out 
after  their  initial  commitment. 


TABLE  6 

COMPARISON  OF  VARIABLES:  PILOT 


MPC1  Multi-Board 


Variable 

Coefficient 

Variable 

Coefficient 

Intercept 

0.1162 

Intercept 

7 .8696 

GPA 

4.5046 

GPA 

2 .4587 

AFOQTP 

0.0715 

SX 

1.4193 

AFOQTA 

0.0358 

BACHPLUS 

1 . 0190 

BACH 

-1.2883 

PRIVLIC 

0 .9284 

CALC 

0.6573 

T 

0.4846 

EVAL114  5 

0.1739 

APRYRS 

0 . 0955 

AFOQT  P 

0 . 0481 

1  (Padgett: 2) 

AFOQT  A 

0. 0278 

AFLYHRS 

0 . 0011 

Navigator .  The  navigator  category  showed  fewer 
similarities  between  the  MPC  and  multi-board  models.  In  this 
case  only  GPA  and  AFOQT_A  were  in  both  regressions.  The  multi¬ 
board  regression  also  included  some  variables  that  might  not  have 
been  available  for  the  MPC  study.  Both  having  a  private  pilot's 
license  (PRIVLIC)  and  the  number  of  letters  of  recommendation 
|  from  generals  (LORS_GEN)  had  large  coefficients.  Being  a 
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minority  and  having  calculus  also  had  fairly  large  coefficients. 
Again,  the  number  of  years  of  prior  service  seemed  to  be  an 
asset. 


TABLE  7 

COMPARISON  OF  VARIABLES:  NAVIGATOR 


MPC1 

Multi 

-Board 

Variable 

Coefficient 

Variable 

Coefficient 

Intercept 

6.5801 

Intercept 

5.7543 

GPA 

2 . 0376 

GPA 

2 .7479 

PGMMING 

1.7053 

PRIVLIC 

2.1306 

AFOQTA 

0.0564 

LORS  GEN 

2 . 0356 

AFOQTN 

0.0547 

MINOR 

0.7676 

BACH 

-0.3533 

T 

0 .4613 

EVAL114  5 

0.2521 

APRYRS 

0.2436 

AFOQT  A 

0 . 0447 

1  (Padgett: 3) 

AFOQT  P 

0. 0374 

WAIVS 

-0.4957 

Non-rated  Operations.  The  non-rated  operations 
category  showed  no  similarities  between  the  two  models  except  for 
the  GPA  variable.  The  variables  with  the  largest  impact  in  the 
multi-board  model  were  GPA,  SX  (being  a  female) ,  T  (having  a 
technical  degree),  and  LORS_GEN.  The  two  variables  with  negative 
coefficients  make  sense.  If  someone  who  was  prior  service  and 
did  not  get  all  9's  on  their  last  three  APR’s,  then  they  would 
not  do  as  well.  The  more  waivers  a  person  had,  the  more  it  hurt 
them. 
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TABLE  8 


COMPARISON  OF  VARIABLES:  NON-RATED  OPERATIONS 


MPC1 

Multi 

-Board 

Variable 

Coefficient 

Variable 

Coefficient 

Intercept 

9.9249 

Intercept 

7 . 5996 

GPA 

2.5217 

GPA 

2 .4682 

MAST 

0.8056 

SX 

1.3317 

CALC 

0.6304 

T 

1 . 1024 

AFOQTQ 

0.0233 

LORS  GEN 

1.0564 

AFOQTV 

0.0203 

LORS  COL 

0.6648 

BACH 

-0.2414 

MARS TAT 

0.5065 

MINOR 

0.4964 

EVAL1145 

0. 1593 

AFOQT  A 

0.0665 

AFLYHRS 

0.0085 

1  (Padgett: 6) 

WAIVS 

-0.5314 

APR 

-0 .8067 

Technical .  Some  interesting  results  came  out  of  the 
regression  for  the  technical  category.  Although  a  factor  like 
GPA  was  a  big  player  (as  would  be  expected) ,  having  a  technical 
degree  (T)  did  not  appear  to  be  significant  at  all.  This  led  to 
the  hypothesis  that  GPA  was  the  overriding  factor.  If  those 
individuals  who  had  technical  degrees  also  had  lower  GPA's,  then 
having  the  technical  degree  might  be  outweighed  by  the  lower  GPA. 
However,  an  analysis  of  the  technical  and  non-technical  GPA's 
showed  that  there  is  no  significant  difference  (all  were  within 
one  standard  deviation  of  each  other) . 
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TABLE  9 


GPA  COMPARISON  FOR  TECHNICAL  AND  NONTECHNICAL  MAJORS 


N 

Mean 

Std  Dev 

Minimum 

Maximum 

PILOT 

Non-tech 

1639 

2.914 

0.4222 

1.6700 

4 . 000 

Tech 

699 

2.913 

0.4439 

1.9300 

3 .990 

NAVIGATOR 

Non-tech 

928 

2.919 

0.4252 

1 .7000 

4 . 000 

Tech 

291 

2.835 

0. 3993 

1.9500 

3 . 950 

NON-RATED  OPERATIONS 

Non-tech 

1404 

3 . 008 

0.4265 

1.8400 

4 . 000 

Tech 

215 

2.788 

0.4217 

2 . 0600 

3 .900 

TECHNICAL 

Non-tech 

403 

3.057 

0.4403 

1.9200 

4 . 000 

Tech 

166 

2 . 987 

0.4261 

2 . 1200 

4 . 000 

NON-TECHNICAL 

Non-tech 

2240 

3.095 

0.4510 

1.5500 

4 . 000 

Tech 

289 

2.949 

0.4562 

1.7700 

3 . 950 

Having  a 

background  in  calculus  did  help  some,  but 

the 

largest  coefficient  was 

on  having 

a  private 

pilot's  license. 

However,  the 

weight  of 

the  GPA  variable  was 

still  higher 

because 

PRIVLIC  is  an 

indicator 

variable , 

so  it  could  only  add  4 

.4183 

points  while 

GPA  could 

add  as  many 

as  10.29 

points.  In  addition, 

for  every  letter  of  recommendation  from  a  general,  the  person 
added  2.6328  to  their  score,  so  this  variable  was  also  an 
important  player. 

Only  the  GPA  variable  was  common  between  the  MPC  and  multi¬ 


board  models,  but  the  real  surprise  was  on  the  variables 


associated  with  highest  degree  level.  In  the  MPC  model,  having  a 
master's  degree  was  a  strong  positive  factor.  In  contrast,  the 
multi-board  model  showed  that  not  having  even  a  bachelor's  degree 
was  significant.  (The  people  who  fell  into  this  category  were 
those  who  were  nearly  finished  with  their  bachelor's  degree,  so 
they  would  meet  the  reguirement  of  having  the  degree  before 
beginning  OTS.)  Both  number  of  years  of  prior  service  ( APRYRS ) 
and  the  number  of  flying  hours  (AFLYHRS)  seemed  to  have  a 
negative  effect,  but  this  time  the  number  of  waivers  (WAIVS)  had 
a  positive  influence  (it  may  be  that  those  with  good  credentials 
but  who  also  have  waivers  end  up  competing  in  this  category) . 


TABLE  10 

COMPARISON  OF  VARIABLES:  TECHNICAL 


MPC1 

Mult  i 

-Board 

Variable 

Coefficient 

Variable 

Coefficient 

Intercept 

4 . 8560 

Intercept 

7 . 5996 

GPA 

3.8188 

PRIVLIC 

4 .4183 

PGMMING 

2.8330 

LORS  GEN 

2 . 6328 

MAST 

2.1511 

GPA 

2.5733 

AFOQTQ 

0.0651 

WAIVS 

1 . 1457 

NOBACH 

1 . 0618 

CALC 

0 . 8735 

AFOQT  A 

0 . 0864 

1  (Padgett: 4 ) 

AFLYHRS 

-0.0251 

APRYRS 

-0 . 1649 

Non-technical .  The  non-technical  category  is  the  only 
one  in  which  every  variable  found  to  be  significant  in  the  MPC 
regression,  was  also  significant  in  the  multi-board  regression. 
GPA  (again  a  big  player) ,  AFOQT_V,  and  AFOQT_Q  were  all  in  both 


34 


models.  The  negative  coefficients  showed  that  both  the  number  of 
regular  waivers  (WAIVS)  and  having  an  age  waiver  (AGEWAIV)  hurt 
an  individual.  The  surprising  coefficient  here  was  the  AFOQT_A 
score,  which  actually  hurt  a  person.  However,  the  coefficient  is 
not  huge  (although  it  still  could  have  an  impact  of  up  to  -5.39 
points)  and  it  is  barely  significant  at  the  .15  level.  This 
seems  to  be  a  category  where  other  factors  (more  political)  come 
into  play.  Females,  minorities,  and  those  with  letters  of 
recommendation  from  colonels  and  generals  all  have  a  leg  up  on 
the  competition. 


TABLE  11 

COMPARISON  OF  VARIABLES:  NON-TECHNICAL 


MPC1  Multi-Board 


Variable 

Coefficient 

Variable 

Coef  f icie 

Intercept 

8.3981 

Intercept 

6 .0143 

GPA 

2 . 5863 

GPA 

2 .4792 

AFOQTQ 

0.1857 

BACHPLUS 

1.0758 

AFOQTV 

0.0418 

LORS  GEN 

0.9158 

SX 

0. 6749 

MINOR 

0 .4489 

CALC 

0 .4345 

LORS  COL 

0.3589 

EVAL1145 

0. 1126 

AFOQT  V 

0.0760 

AFOQT  Q 

0 . 0635 

AFOQT  P 

0.0130 

AFOQT  A 

-0.0539 

1  ( Padgett : 5 ) 

AGEWAIV 

-0.4588 

WAIVS 

-0.6194 

Aptness  Assessment.  The  first  requirement  of  the  normal 
error  model  is  that  the  function  must  be  linear.  Since  this 
model  is  multi-dimensional,  it  is  impossible  to  graph  the 
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function.  Therefore,  a  graph  of  the  actual  versus  predicted 
values  was  used  to  give  an  indication  of  how  well  the  model  fit 
the  data.  If  the  graph  showed  a  linear  trend  of  some  sort,  then 
the  model  must  have  a  reasonable  fit.  The  graphs  for  the  pilot 
and  nontechnical  categories  were  especially  good.  (The  pilot 
graph  is  included  a  Figure  3.  See  Appendix  D  for  the  remaining 
graphs . ) 

The  model  can  be  shown  to  satisfy  the  second  and  third 
assumptions  of  the  normal  error  model.  Residual  graphs  verified 
that  the  variance  of  the  error  terms  was  constant.  The  residual 
plots  for  the  pilot,  navigator,  non-rated  operations,  and  non¬ 
technical  categories  took  on  a  circular  shape.  (See  Figure  4  for 
the  pilot  graph,  and  Appendix  E  for  the  remaining  graphs.) 
Although  a  circular  shape  indicates  that  the  variance  is  not 
constant  (it  increases  and  then  decreases  again) ,  it  actually 
demonstrates  an  interesting  fact.  The  model  did  a  good  job  of 
predicting  board  scores  that  are  either  very  high  or  very  low 
(hence  the  low  residuals  at  the  ends) .  However,  the  model  did 
not  do  as  good  a  job  of  predicting  mid-level  board  scores,  so  the 
residuals  and  the  variance  of  the  residuals  were  greater.  In  the 
technical  category,  there  appeared  to  be  a  noticeable  decrease  in 
the  variance  of  the  residuals.  Therefore  this  model  might  be 
improved  if  a  logarithmic  transformation  of  the  dependent 
variable,  board  score,  were  used  in  the  regression  analysis  (see 
Appendix  F  for  the  results  of  this  logarithmic  transformation) . 
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Plot  of  BDTOT*PREDBD.  Legend:  A  =  1  obs,  B  =  2  obs ,  etc. 
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Figure  3.  Predicted  vs  Actual  Board  Score  (Pilot) 
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Plot  of  YRESID*YHAT.  Legend:  A  =  1  obs,  B  =  2  obs,  etc. 
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Finally,  the  normality  of  the  error  terms  must  be 
substantiated.  When  ordered  residuals  are  plotted  against 
residual  rankings,  they  should  form  a  straight  line  if  the  error 
terms  are  normal.  In  all  five  categories,  the  Q-Q  plots  were,  in 
fact,  very  close  to  straight  lines.  (The  pilot  Q-Q  plot  is  shown 
in  Figure  5.  See  Appendix  G  for  the  remaining  plots.) 
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Figure  5.  Q-Q  Plot  (Pilot) 


R-square .  Although  the  R-square  values  are  not  especially 
high  for  any  of  the  multi-board  regressions,  they  do  indicate 
that  the  models  have  some  explanatory  power;  and  there  are  other 
ways  of  measuring  the  success  of  this  type  of  model  (i.e. 
prediction  results) .  A  comparison  of  the  MPC  model  R-square 
values  and  the  multi-board  r-square  values  showed  major 
improvements  in  three  areas:  non-rated  operations,  technical, 
and  non-technical ,  no  change  in  the  navigator  category,  and  a 
fairly  large  decrease  in  the  pilot  category.  The  adjusted  R- 
square  values  indicate  that  the  number  of  variables  being  used  in 
the  models  is  not  excessive — all  of  the  adjusted  values  are  just 
a  little  lower  than  the  regular  R-square  values. 


TABLE  12 

COMPARISON  OF  R-SQUARE  VALUES 


MPC1 

Multi 

-Board 

e! 

r! 

Adi  R' 

Pilot 

.47 

.  320 

.316 

Navigator 

.  36 

.361 

.355 

Non-rated  Operations 

.  15 

.266 

.260 

Technical 

.  14 

.239 

.  226 

Non-technical 

.  14 

.316 

.313 

1  (Padgett : 2-6) 

Significance  and  Lack  of  Fit  Tests.  The  use  of  the  partial 
F  test  to  determine  which  variables  should  be  included  in  the 
model  (based  on  each  variable's  marginal  significance),  was 
described  in  the  previous  chapter.  Once  the  pool  of  variables 
had  been  narrowed  down  by  the  STEPWISE  procedure,  two  other  tests 


41 


were  used  to  test  the  significance  of  the  individual  variables 
and  the  overall  fit  of  the  model. 

The  t  test  was  used  to  ensure  that  all  of  the  variables 
included  in  the  model  added  significance  to  the  model  at  the  .15 
significance  level.  (Any  variables  not  meeting  this  requirement 
were  dropped  one  at  a  time) .  Then  each  of  the  five  models  was 
tested  for  lack  of  fit  using  the  overall  F  test.  All  five  models 
were  shown  to  exhibit  no  sign  of  lack  of  fit.  (Refer  to  Appendix 
G  for  the  t-statistics ,  F-statistic,  and  p-values  for  all  five 
models . ) 

Validation.  The  final,  and  perhaps  the  most  important  test 
of  the  multi-board  regression  model  was  how  well  the  model 
actually  predicted  board  scores.  The  validation  group  was  all 
individuals  whose  SSAN  ended  in  nine  (they  were  not  included  in 
the  regression  model) .  The  predicted  board  scores  were 
calculated  for  each  of  the  five  categories.  The  prediction  error 
for  the  multi-board  model  are  all  higher,  except  in  the  non¬ 
technical  category.  This  result  was  not  unexpected  because  the 
MPC  model  used  one  board  to  predict  the  very  next  board.  The 
likelihood  of  any  large  changes  in  selection  philosophy  is  much 
smaller  than  in  the  multi-board  case.  (Table  13  shows  the 
com- orison  of  the  prediction  errors  for  the  MPC  and  Multi-board 
mod-  s.  Other  statistics  for  the  prediction  error  for  the  Multi¬ 
board  model  can  be  found  in  Appendix  H.) 
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TABLE  13 


PREDICTION  ERROR  COMPARISON 


MPC 

Multi 

-board 

Mean 

Mean 

Std  Dev 

Pilot 

2 . 021 

2.173 

1.632 

Navigator 

1.576 

2.334 

1 . 734 

Non-rated  Operations 

2 . 116 

2 .797 

1.911 

Technical 

1.814 

3.436 

2.711 

Non-technical 

3 . 156 

2 .848 

1.958 

Overall 

2 . 375 

2 . 598 

Discriminant  Analysis 

The  test  for  homogeneity  of  the  within  covariances  showed 
overwhelmingly  that  the  within  covariance  matrices  for  all  five 
categories  were  not  the  same.  If  the  pooled  covariance  matrix 
had  been  used,  the  discriminant  function  coefficients  would  be 
included  in  the  output.  However,  these  coefficients  were  not 
given  since  the  within  covariance  matrices  were  used. 

The  discriminant  function  was  calculated  using  all  records 
with  SSAN's  ending  in  the  digits  0-8.  These  records  were  then 
classified  into  groups  based  on  this  discriminant  function.  Then 
the  validation  was  done  using  the  remaining  records  (SSAN's 
ending  in  9).  These  were  also  classified  into  groups.  Results 
from  both  of  these  classifications  were  given  in  terms  of  percent 
of  correct  classifications  and  misclassif ications . 

In  all  five  categories,  the  percent  of  group  II  records 
(approximately  the  bottom  67%)  that  were  correctly  identified  as 
group  II,  was  quite  high.  However,  the  discriminant  function  did 


43 


a  poor  job  of  classifying  group  I  records  as  group  I.  This 
seemed  to  indicate  that  it  was  much  easier  to  identify  those 
records  that  should  receive  lower  board  scores  rather  than  those 
that  should  receive  high  scores.  (Table  14  shows  the 
classification  results  for  the  main  se.  and  the  test  set  of 
records  in  the  pilot  category.  Appendix  I  contains  the  remaining 
results . ) 


TABLE  14 

CLASSIFICATION  RESULTS:  PILOT 


Main  Group 


TO 

Group  1 

Percent 

Group  2 

Percent 

Total 

FROM 

Group  1 

224 

32.70 

461 

67.30 

685 

Group  2 

115 

6.96 

1538 

93 . 04 

1653 

Total 

339 

14 . 50 

1999 

85.50 

2338 

Priors 

29.30 

70.70 

Error 

67 . 30 

6.96 

Validation 

Group 

TO 

Group  1 

Percent 

Group  2 

Percent 

Total 

FROM 

Group  1 

29 

31.52 

63 

68 .48 

92 

Group  2 

16 

8 . 60 

170 

91.40 

186 

Total 

45 

16.19 

233 

83.81 

278 

Priors 

29.30 

70. 70 

Error 

68 .48 

8 . 60 
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V.  Conclusion 


This  chapter  addresses  the  effectiveness  of  the 
methodologies  used  in  this  analysis,  some  points  for  management 
consideration,  and  possible  areas  for  further  research. 

The  regression  analysis  showed  that  there  are  some  factors 
which  are  very  important  in  the  selection  board  process.  GPA 
seems  to  be  the  most  universally  accepted  measure  of  merit. 

Other  variables  representing  analytical  abilities  and  flying- 
related  activities  or  abilities  also  seemed  to  add  explanatory 
power.  The  overall  power  of  the  regression  is  somewhat  limited. 
Based  on  the  results  of  this  study,  the  board  scores  can  be 
predicted  with  about  95%  certainty  to  ±  6  points.  This  means 
that  the  capability  gained  from  this  study  is  the  ability  to 
classify  an  individual  record  in  the  top,  middle,  or  bottom. 
Therefore,  the  records  could  still  be  appropriately  mixed  and 
sent  to  the  boards  to  be  scored,  but  double-checking  the  board 
score  with  the  predicted  score  should  only  be  considered  for 
ensuring  the  board  score  is  in  the  "ball  park"  (within  one 
standard  deviation  of  the  predicted  score  may  be  too  tight  a 
restriction) . 

There  may  be  several  factors  behind  the  failure  of  the 
discriminant  approach  to  accurately  classify  applicants  in  the 
top  33%  or  bottom  67%.  The  first,  and  most  obvious,  is  that  the 
criteria  used  to  split  the  individuals  into  two  groups  was 
somewhat  arbitrary.  The  top  33%  (and  bottom  67%)  number  was  used 
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because  historically,  33%  of  the  applicants  are  selected. 

However,  this  is  only  a  surrogate  for  selection.  If  the  actual 
selection/non-selection  results  were  used,  discriminant  analysis 
might  have  proven  effective. 

The  other  problem  with  this  approach  to  discriminant 
analysis  is  that  many  of  the  factors  were  not  captured  in  the 
data,  and  therefore  could  not  be  used  in  this  portion  of  the 
analysis — this  also  includes  indicator  variables  and  those 
factors  which  are  considered  in  the  final  selection  process. 

Recommendations  for  Management 

Two  areas  of  concern  may  require  management  consideration. 
The  first  deals  with  the  database.  If  the  records  are  to  be  kept 
for  just  this  type  of  research,  then  the  accuracy  and 
completeness  of  the  data  are  of  paramount  importance.  Far  too 
many  assumptions  had  to  be  made  concerning  missing  data.  In 
addition,  the  reapplication  procedures  require  constant  updating 
of  the  individuals'  paper  records  as  well  as  the  database.  This 
is  definitely  a  potential  problem  area  if  the  two  do  not  match. 
Finally,  some  consideration  should  be  given  to  the  addition  of 
other  information  to  the  data  base  (see  Table  1) . 

The  second  area  concerns  the  final  selection  process. 
Frequency  plots  of  the  board  scores  show  an  interesting  result. 

If  the  selection  rate  is  roughly  33%  of  the  applicants,  then  the 
cut-off  would  be  at  a  board  score  of  23.  (Figure  6  shows  the 
distribution  of  the  scores  and  the  cut-off.  Appendix  J  shows  the 
cumulative  distribution  of  scores.)  The  fact  that  the  line  is 
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drawn  right  in  the  middle  of  the  highest  frequency  of  scores  is  a 
definite  cause  for  concern.  Any  shifting  of  the  cut-off  line  has 
the  potential  to  impact  hundreds  of  applicants  (it  is  not  a 
situation  where  a  couple  of  individuals  are  right  above  or  below 
the  line) .  Ideally,  such  a  line  would  be  drawn  so  that  it 
includes  the  top  or  bottom  tail  of  such  a  distribution  of  scores. 
The  large  middle  section  of  scores  (from  roughly  18-26) 
represents  a  large  gray  area.  Traditionally,  it  is  much  easier 
to  classify  those  individuals  who  should  receive  vej.y  high  and 
very  low  scores.  The  most  difficult  is  distinguishing  among  the 
more  "average"  scores.  This  is  why  a  line  drawn  right  in  the 
middle  of  these  "average"  scores  should  cause  concern. 

The  use  of  the  MPC  regression  model  to  double-check  scores 
may  be  hindering  any  efforts  by  the  board  to  distinguish  between 
average  and  outstanding  records.  The  MPC  regression  model  most 
likely  produces  an  average  board  score  that  is  higher  than  it 
should  be,  and  any  time  the  board  assigns  a  score  that  deviates 
from  the  predicted  score,  they  are  forced  to  go  back  and  rescore 
the  record.  Any  time  this  rescoring  occurs,  the  final  resulting 
score  is  going  to  be  very  close  to  the  predicted  score.  If  any 
predictive  model  is  used  to  check  the  board  scores,  it  should 
force  a  mean  somewhere  in  the  15-18  point  range  (not  the  20-24 
range)  . 

Recommendations  for  Further  Study 

Three  areas  stand  out  as  potential  topics  for  further 
research.  The  first  is  further  regression  analysis. 
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Plot  of  FREQ*BDSCORE.  Legend:  A  =  1  obs,  B  =  2  obs,  etc, 
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Figure  6.  Board  Score  Frequency  Plot 
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However,  instead  of  using  the  information  from  one  board  or  many 
boards,  the  emphasis  would  be  on  determining  how  many  boards 
should  be  used  to  do  the  best  job  of  predicting  the  scores  of  the 
next  board.  To  be  useful  to  Recruiting  Services  (RS) ,  this  would 
require  running  a  new  regression  for  every  board  using  the  number 
of  previous  boards  indicated  by  the  analysis.  This  approach 
would  appear  to  do  the  best  job  of  accomplishing  Recruiting 
Service's  objective  of  accurately  predicting  the  board  scores 
prior  to  each  board. 

The  second  area  deals  with  using  discriminant  analysis  (and 
possibly  logistic  regression)  to  attempt  to  classify  individuals 
in  select/non-select  categories.  This  would  indicate  exactly 
what  factors  are  being  used  in  the  final  selection  process. 

Finally,  on  a  more  general  note,  determining  what  factors 
are  currently  being  used  for  board  scores  and  selections  can  be 
used  to  verify  current  selection  strategies  or  to  point  out 
potential  problems.  However,  the  real  problem  seems  to  be  one  of 
determining  which  factors  actually  predict  how  well  an  individual 
will  perform  (either  in  OTS  or  in  the  Air  Force,  itself)  once 
he/she  is  selected.  The  emphasis  for  such  a  study  would  be 
placed  on  determining  what  factor(s)  best  describe  how 
successfully  the  individual  has  performed  and  then  finding  the 
factors  that  most  accurately  predict  this  performance. 
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Appendix  A:  Alphabetic  List  of  Variables  and  Attributes 


# 

Variable 

Type 

Len 

Pos 

Label 

83 

ACOMMDT 

Num 

8 

314 

Date  -  OTS  Commission 

84 

ADISP 

Char 

2 

322 

Disposition  Code 

85 

ADOB 

Num 

8 

324 

Date  of  Birth 

86 

ADOE 

Num 

8 

332 

Date  -  Enlistment  - 
Actual 

87 

AELIMDSP 

Char 

1 

340 

OTS  Eliminee  Disposition 

88 

AELIMRSN 

Char 

3 

341 

OTS  Elimination  Reason 

89 

AFLYHRS 

Num 

8 

344 

Special  Qualifications  - 
Flying  Hours 

12 

AFOQT_A 

Num 

O 

31 

AFOQT  Percentile  Score  - 
Academic 

7 

AFOQT_FM 

Char 

1 

17 

AFOQT  Test  Form  ID 

11 

AFOQT_N 

Num 

3 

28 

AFOQT  Percentile  Score  - 
Navigator 

10 

AFOQT_P 

Num 

3 

25 

AFOQT  Percentile  Score  - 
Pilot 

14 

AFOQTJ2 

Num 

3 

37 

AFOQT  Percentile  Score  - 
Quantitative 

13 

AFOQT_V 

Num 

3 

34 

AFOQT  Percentile  Score  - 
Verbal 

8 

AFSC 

Char 

3 

18 

DAFSC  (Active  Duty 

Only) 

15 

AFSC1 

Char 

3 

40 

AFSC  (1st  choice  or 
select) 

90 

AGPA1 

Num 

8 

352 

Academic  Educ  Lvl  GPA  - 
Highest 

91 

AGPA2 

Num 

8 

360 

Academic  Educ  Lvl  GPA  - 
2nd  Highest 
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# 

Variable 

Type 

Len 

Pos 

Label 

2  7 

ALL9LST3 

Char 

1 

68 

Overall  9s  Last  3 
Ratings 

92 

APIDBRD 

Char 

1 

368 

Program  Identity  - 
Applied/Selected  Brd 

93 

APIDSRC 

Char 

1 

369 

Program  Identity  - 
Source  Board 

94 

APPL 

Char 

1 

370 

Private  Pilots  Liscence 

22 

APPSTAT2 

Char 

1 

59 

Secondary  Applicant 
Status 

28 

APP_STAT 

Char 

1 

69 

Applicant  Status  (A=AD 
N=NPS ) 

95 

APROGHEL 

Char 

1 

371 

Program  Applying  For  - 
Helicopter  Pilot 

96 

APROGMSL 

Char 

1 

372 

Program  Applying  For  - 
Missile  Officer 

97 

APROGNAV 

Char 

1 

373 

Program  Applying  For  - 
Navigator 

98 

APROGOTH 

Char 

1 

374 

Program  Applying  For  - 
Other 

99 

APROGPIL 

Char 

1 

375 

Program  Applying  For  - 
Pilot 

100 

APROGWPN 

Char 

1 

376 

Program  Applying  For  - 
Weapons  Officer 

101 

APRYRS 

Num 

8 

377 

Prior  Service  -  TAFMS 
Length  (Years) 

102 

ARISTAT 

Char 

2 

385 

Record  ID  -  Status  of 
Applicant 

103 

ARITYPE 

Char 

1 

387 

Record  ID  -  Program 
Applying  For 

16 

AVAIL_DT 

Char 

4 

43 

Available  Date  (YYMM) 

35 

CALCULUS 

Char 

1 

82 

Special  Qualification  - 
Calculus 

51 


# 

Variable 

Type 

Len 

Pos 

Label 

37 

CURRBRD 

Num 

8 

86 

Current  Board  Number 
(RSO) 

9 

DEG_TYPE 

Char 

4 

21 

Degree  Type 

32 

DISENROL 

Char 

1 

77 

Disenrollment  from  a 
Commissioning  Prog 

6 

DOBBYYMM 

Char 

4 

13 

Date  of  Birth  (YYMM) 

18 

ETHNIC 

Char 

1 

48 

Ethnic  Code 

24 

EVAL1145 

Num 

3 

63 

1145  Evaluation  (1-5) 

1 

FIREWALL 

Char 

1 

0 

Firewall  9s  for  Non-Tech 
Only  (Y/N) 

36 

GRADE 

Num 

3 

83 

Military  Grade 

23 

GRADYEAR 

Num 

3 

60 

Year  of  Graduation 

33 

LORS_COL 

Num 

3 

78 

Number  of  LORs  from 
Colonels 

30 

LORS_GEN 

Num 

3 

71 

Number  of  LORs  from 
Generals 

31 

LORS_TOT 

Num 

3 

74 

Numbers  of  Other  LORs 

39 

M1BDNUM 

Num 

8 

102 

41 

M1BDSTAT 

Char 

1 

118 

Board  Status 

40 

M1BDTOT 

Num 

8 

110 

Total  Board  Score 

47 

M1DEGLEV 

Char 

1 

145 

Degree  Level 

49 

M1GPA 

Num 

8 

147 

Grade  Point  Average 

43 

M1MATRIX 

Num 

8 

120 

Matrix  Score  for 
Pilot/Nav 

46 

Ml PANEL 

Num 

8 

137 

Panel  Number 

42 

Ml PROG 

Char 

1 

119 

Program  Applying  To 

44 

M1SELECT 

Char 

1 

128 

Select  Status 

52 


# 

Variable 

Type 

Len 

Pos 

Label 

45 

M1TILT 

Num 

8 

129 

Tilt  Score  for  Nav,  Tec 
Non-Tech 

48 

M1TRACKR 

Char 

1 

146 

Tracking  Code 

50 

M2BDNUM 

Num 

8 

155 

52 

M2BDSTAT 

Char 

1 

171 

Board  Status 

51 

M2BDTOT 

Num 

8 

163 

Total  Board  Score 

58 

M2DEGLEV 

Chai 

1 

198 

Degree  Level 

60 

M2GPA 

Num 

8 

200 

Grade  Point  Average 

54 

M2MATRIX 

Num 

8 

173 

Matrix  Score  for 
Pilot/Nav 

57 

M2 PANEL 

Num 

8 

190 

Panel  Number 

53 

M2 PROG 

Char 

1 

17  2 

Program  Applying  To 

55 

M2SELECT 

Char 

1 

181 

Select  Status 

56 

M2TILT 

Num 

8 

182 

Tilt  Score  for  Nav,  Tec 
Non-Tech 

59 

M2 TRACER 

Char 

1 

199 

Tracking  Code 

61 

M3BDNUM 

Num 

8 

208 

63 

M3BDSTAT 

Char 

1 

224 

Board  Status 

62 

M3BDTOT 

Num 

8 

216 

Total  Board  Score 

69 

M3DEGLEV 

Char 

1 

251 

Degree  Level 

71 

M3GPA 

Num 

8 

253 

Grade  Point  Average 

65 

M3MATRIX 

Num 

8 

226 

Matrix  Score  for 
Pilot/Nav 

68 

M3PANEL 

Num 

8 

243 

Panel  Number 

64 

M3 PROG 

Char 

1 

225 

Program  Applying  To 

66 

M3SELECT 

Char 

1 

234 

Select  Status 

53 


# 

Variable 

Type 

Len 

Pos 

Label 

67 

M3TILT 

Nuxn 

8 

235 

Tilt  Score  for  Nav,  Tec, 
Non-Tech 

70 

M3TRACKR 

Char 

1 

252 

Tracking  Code 

72 

M4BDNUM 

Num 

8 

261 

74 

M4BDSTAT 

Char 

1 

277 

Board  Status 

73 

M4BDTOT 

Num 

8 

269 

Total  Board  Score 

80 

M4DEGLEV 

Char 

1 

304 

Degree  Level 

82 

M4GPA 

Num 

8 

306 

Grade  Point  Average 

76 

M4MATRIX 

Num 

8 

279 

Matrix  Score  for 
Pilot/Nav 

79 

M4 PANEL 

Num 

8 

296 

Panel  Number 

75 

M4PROG 

Char 

1 

278 

Program  Applying  To 

77 

M4SELECT 

Char 

1 

287 

Select  Status 

78 

M4TILT 

Num 

8 

288 

Tilt  Score  for  Nav,  Tec, 
Non-Tech 

81 

M4TRACKR 

Char 

1 

305 

Tracking  Code 

19 

MARITAL 

Char 

1 

49 

Marital  Status 

105 

ONI  5  6 

Num 

3 

391 

Matched  ATC  156  to  RSO 
( l=Yes) 

104 

ONAPPS 

Num 

3 

388 

Matched  to  OTS  Apps  to 
RSO  ( l=Yes) 

2 

OTSROTC 

Char 

1 

1 

Non-select  OTS  or  AFROTC 
(Y/N) 

20 

PHYS_DT 

Num 

8 

50 

Date  of  Physical 

21 

PROMIS 

Char 

1 

58 

PROMIS  Flag 

4 

RACE 

Char 

1 

11 

Race  ( C , N , 0 , X ) 

29 

REVFLAG 

Char 

1 

70 

Review  Criterion  Flag 

34 

RSOPPL 

Char 

1 

81 

Private  Pilots  License 

Variable 

Type 

Len 

Pos 

Label 

SEX 

Char 

1 

12 

Sex  (M/F) 

SPONSOR 

Char 

1 

47 

Military  Sponsor 

SSAN 

Char 

9 

2 

Social  Security  Number 

TOTBDMET 

Num 

8 

94 

Total  Number  of  Boards 
Met  (RSO) 

WAIVER1 

Char 

1 

66 

Age  Waiver 

WAIVER2 


Char 


1 


67 


Other  Waiver 
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APPLICATION  FOR  TRAINING  LEADING  TO  A  COMMISSION 
.  IN  THE  UNITED  STATES  AIR  FORCE 


OMI  NO.  0701  -OOO! 

Eip>m;  31  Mjy  1M1 


authority  lOUSC  3 107.  Fminc, it  Assisume  Ptogum  ter  Specutly  Selected  Membert.  lOUSC  94  it.  Embftshment  end  Purpose  of  Schools  end 
Cimps  Implemented  by  AFP  S3  30  Airmen  Commissioning  Progrtms  end  AFP  S3  37  0  filter  Truning  School  USAF  (OTS) 

PRINCIPAL  PURPOSl  To  document  evidence  of  ipphcmon  for  consident/on  to  enter  in  officer  mining  prognm  with  subsequent  commissioning 
end  vohjntiry  contractual  agreement  to  serve  the  pertoa  specified 
ROUTINE  USE  None 

DISCLOSURE  IS  VOLUNTARY  Future  to  furnish  the  ml ormehon  may  result  in  dennl  ol  consider! tion  lor  tr lining  leidmg  to  I  commission 


Pubnc  reporting  burden  for  this  collect. on  is  est. mated  to  average  30  minutes  per  responsr  .  including  the  lime  (O'  reviewing  instructions  searching 
data  souces.  gathering  and  maintaining  the  data  needed  and  completing  and  reviewing  tne  collection  of  information  Send  comments  regarding 
this  burden  es'imate  O'  any  otne'  aspect  o!  this  collection  of  information,  including  suggestions  tor  reducing  this  burden,  to  Washington 
HeadquanersServices  Directorate  for  information  Ope  rations  and  Re  ports.  12  IS  Jefferson  Davis  Highway.  Suite  1204,  Arlington  VA  22202-4302.  and 
to  the  Office  of  information  and  Regulatory  Affairs  Office  of  Management  and  Budget.  Washington  DC  20503 


INSTRUCTIONS 


(A)  Use  typewriter  or  print  clearly  in  mk.  Add  the  zip  code 
to  all  addresses 

(B)  When  allotted  space  is  insufficient,  continue  on  page  4 
of  this  form  Provide  a  complete  explanation  for  each  item. 
(Identify  each  item  with  the  item  number  ) 

(C)  Enter  all  dates  using  day,  month,  and  year  sequence 
(i.e  .  15  Jan  88) 

(D)  Be  certain  that  you  understand  and  agree  to  the 
certification  m  item  19  prior  to  signing  this  appl  'ation. 


fflasr  Fust  Middle  initnl)  IMuden  if  ipphcibiel 


DATE  DEPARTEDCONUS 


(E)  Enter  "None*  or  "Not  Applicable"  in  any  item  that  does 
not  apply  or  to  which  you  have  no  response, 

(F)  include  a  transcript  or  certificate  of  completion  for  each 
earned  degree  reflected  m  item  10. 

NOTE  Your  home  of  record  is  the  actual  place  designated  as 
your  home  when  you  are  commissioned,  reinstated,  appointed, 
reappointed,  enlisted,  inducted,  or  ordered  to  active  duty.  This 
address  is  used  to  determine  travel  entitlements  when  you 
terminate  from  active  duty. 


active  duty  military  applicants  ONI  Y 


TAFMSD  SERVING  Q/S 

ACC  BY  DEPN 


DATE  u,  HOLE  TO  RETURN 


DATE  or  BIRTH  DATE  avail. ABIE  FOR  TRAINING  DEPENDENTS  (Other  thin  spouse,  no  dependent  complete I 

9  Aug  #  900301  y0u> 


marital  status 


SERVICING  CBPO  (include  PAS  codr) 


5.  LEGAL  STATE  Of  RESIDENCE  (AE O*  spphctnti  only)  CBPO  PHONE  NUMBERS  (includr  srt*  (Ode) 

COMM  AUTOVON 


PERSONAL  DATA 


no  ves  cn*'*  rJCO'OD'iare  -re^;  X  native  BORN  Derivative  natuaauZEO 


married  to  military  member  MARRIED  to  civilian  separated  divorceo  widowed 


APPLICANT  FOR  (Chec*  and  imuil  program  #nd  category  for  which  applying)  _ 


program 


OFFICER  TRAINING  SCHOOL  lOT5)C^>  AFROTC  AIRMAN  SCHOLARSHIP  AND  COMMISSIONING  PROGRAM  (AfPO  TC‘ASCP) 


AIRMAN  EDUCATION  AND  COMMISSIONING  PROGRAM  ^A£CP;  l  OTHER  (Speofyj 


LINE  CATEGORIES  (India  tr  In  2nd.  and  3rd  chotcrs) 


PILOT  9 NAVIGATOR  MISSILEER  support  operations  helicopter  pilowots  on>y) 


AIR  WEAPONS  CONTROLLER  (VOluntrrr  for  flying  duty  _ Y£S  !  OTHER  5UPPORT  PREFERENCE  (See  «tem  8)  _ 


NONLINE  CATEGORIES 


PREMEDICAL  NURSE 


8.  SUPPORT  (tno>cite  inter)  ruse  utih/*i>on  firia  Mies.  nor  codes;  f£or  A £CP  »na  AfROTC-ASCP  use  arurra  degree  M/es.  f or  tmmpir,  (ircmai  £og»neenr>g) 
Mi  (2)  (J) 


9  AFOQT  SCORES  (Only  Af~tCOi  c  Umi  Commanorn  are  authorized  to enrer  scores) 


-DATE  TESTED  '  —  PILOT  .  ~ 

?•  -3891030  :*;r  -  96'  n1' 


DEGPEEISJ  EARNED  AND  YEASliJ  t'r  B! 


maio*  SuBiFCKS;  ni  Biolo 


ADVANCED  degpeeisi  earned  AND  YEAPIS) 


MAJOR  SUBIECTISI  (') 


HOURS  graduate  wOR«  t No  idvinted degree  enned > 


AF  Form  r,6.  SEP  88  '  lonm*  >s  obsoh  n 


EDUCATION 


id  BS-1988 
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AERONAUTICAL  TRAINING 


1/ ST  OTHER  ADVANCE  O  AERONAUTIC  A  l  RATINGS  YOU  HOLD 


PRIVATE  RILOT  LICENSE 


COMMERCIAL  PILOT  LICENSE 


\2.  A  HAVE  YOU  EVER  PREVIOUSLY  MADE  APPLICATION  F  OR  OR  BEEN  ENROLLED  IN  A  PROGRAM  LEADING  TO  A  COMMISSION  IN  ANY  COMPONENT  0* 
THE  UNIFORMED  SERVICES  (include  s erwice  <cadern.es  RO K  programs  Qffne>  Candrdaie  Training.  OCS.  Platoon  Leader!  Course.  Ort'ter  J  reining 
School  (OW.  etc  > 


B  NAME  OR  NATURE  Of 

|  DATES 

PROGRAM 

1  APPLIED  1 

1  ENROLLED 

RESULTS 


COMPLETED 


DID  YOU  INCUR  AN  ACTIV|^DUTY  SERVICE  COMMITMENT? 

PH  yes  Pel  "YES*  emer  ifte  dare  i^e  commfrmfnr  was  sai»sNed; 


m 

IH 


13.  WERE  YOU  EVER  ELIMINATED  FROM  A  COURSE  OE  INSTRUCTION  IN  A  MILITARY  FLYING  SCHOOL  LEADING  TO  AN  AERONAUTICAL  RATING^ 
(Include  AfROT  C  USAFA.  end  OTS  tight  pie ne  t  reining,  AVROC.  Navy  AOCS;  etc) 


TYRE  Of  TRAINING 


(H  "y(S*  complete  me  mformeuon  below) 


reason  for  ELIMINATION 


NAME  of  SCHOOL 


HAVE  YOU  EVER  PREVIOUSLY  MAOf  APPLICATION  f  OR  OR  if  EN  ENLISTED  IN  ANY  COMPONENT  Of  THE  UNIT  ORMED  SERVICES? 

PI  yes  PH  C 1  *>'ES"  comp/ere  siafe^e^f  below  m  (hronoiOQKet  order) 


PRIMARY 

AfSC 


DUTY  OR  COURSE  TITLE  \ 


15.  HAVE  YOU  EVER  BEEN  INVOLVED.  ARRESTED,  INDICTED,  OR  CONVICTFD  FOR  ANY  VIOLATION  OF  CIVIL  OR  MILITARY  LAW.  INCLUDING 
NON>UD»ClAl  PUNISHMENT  PURSUANT  TO  ARTICLE  15  OF  'THE  UCM)  OR  MINOR  TRAFFIC  VIOLATIONS? 

(j^fj  NO  (if  mY($~  e»pia>n  b+io w  (?sf  an  o^enses  rha-ged  agauisr  you  regardless  of  fmei  d'Spos»f'on,  including  such  srtuatronj 
where  the  mvotvement  has  nor  been  recorded  loceiiy  or  r he  record  has  been  ordered  sealed  or  espunged  by  the  court  ) 


OFFENSE 


Failure  to 


_  SIXUAIDATA 


A.  HAVE  YOU  EVER  SEEN  OR  ARE  YOU  CURRENTLY  HOMOSEXUAL  OR  HSfxUAL?  IHomoiriuil  it  Ottinfa  tl  Stwutl  Otl "*  0'  C*r\lvlOr  <jir*c1H)  At 
personfj)  oF  one  s  own  ser  brseiuaf  <s  defined  as  a  person  se»ua/iy  respons»ve  to  both  seres ) 

□  yES 

t.  HAVE  YOU  EVER  ENGAGEOJN,  OR  00  YOU  DESIRE  TO  OR  INTEND  TO  ENGAGE  IN  A  HOMOSEXUAL  ACT  OR  ACTST 

Qyes  [X]^  I 


17.  EMPLOYMENT  RECORD  (Begin  with  your  present  position  end  work  beck  Do  not  enter  pert  time  employment  of  lea  then  60  deyt  duretion  ) 


EMPLOYER 

KIND  OF  WORK 

Terrv  G.  Tvler 

Fit.  Instructor 

iWajcrest  Apartments 

Maintenance 

DATES  (FROM  TO) 


Salary 


REASON  TERMINATED 


a:  Form  S (  <8 
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II.  I  UNDE  I  ST  A  NO  AND  ACRE  I  THAT: 


APPLICANT'S 

INITIALS 


**  A.  No  promises  have  been  made  to  me  conceding  the  selection  or  utilization  held  ol  assignment,  if  selected 


’(  B.  (flying  Of  Technical  T timing  C*nd,ditti)  If  I  do  not  complete  the  couise  of  flying  training  or  all  technical  training  require 
■77  ■  ments.  or  formal  upgrade  or  certification  training  as  defined  in  APR  36  1 2.  the  needs  of  the  Air  force  will  determine  whether  or 

ai*.  not  I  remain  on  active  duty  if  I  remain  on  active  duty,  i  agree  to  accept  and  serve  the  active  duty  service  commitment(s) 

associated  with  withdrawal  or  elimination  from  an  education  or  training  event,  according  to  APR  36  51.  Table  8 


C  (OTS  Applicants  Only)  If  I  am  medically  disqualified  from  the  career  field  for  which  selected.  I  may  be  eliminated  from  OTS 
.  t  unless  my  academic  background  and  experience  can  be  utilized  m  another  career  field 


•  D.  (OTS/Af  CP  Applicants  Only)  Following  OTS.  my  initial  assignment  as  a  commissioned  officer  will  not  be  back  to  my  current 
base  of  assignment  (AFR  36  ?0) 


£.  (OTS/AF CP  Applicants  Only)  I  am  a  bonus  recipient  still  serving  on  a  term  of  enlistment  or  extension  for  which  the  bonus  was 
paid  and  Still  due  to  receive  future  annual  installment  payment(s)  I  understand  that  on  the  first  class  day  of  OTS/ACCP.  my 
.  future  annual  installment  payment(s)  wifi  be  suspended  H  l  am  eventually  commissioned.  I  will  lose  all  entitlements  to  the 
P  “  suspended  payments  If  I  am  not  commissioned  and  am  returned  to  enlisted  status  in  my  bonus  skill.  I  will  begin  receiving  my 
installment  payments,  less  a  deduction  for  the  time  spent  in  the  commissioning  firoqrim 


F.  <AEC0  Applicants  Only)  As  a  condition  of  receiving  advanced  education  as  defined  m  Title  10  United  States  Code.  Section  2005. 
i  understand  and  agree 


( 1 )  To  complete  the  academic  and  military  requirements  specified  m  APR  53  20.  and  to  serve  on  active  duty  for  the  period 
^  specified  in  this  agreement 


r."  (2)  (Shouid  i  fail  to  complete  the  academic  or  military  requirements  of  APR  53  20,  or  refuse  to  accept  an  appointment  m  the 

T*  Air  force,  d  offered,  to  serve  on  active  duty  for  the  remaining  portion  of  my  enlistment  contract 


—f  (3)  Should  i  voluntarily  or  because  of  misconduct  fail  to  complete  either  period  of  active  duty,  to  reimburse  the  United 
J  .  'States  for  the  percentage  of  the  cost  of  my  education  (The  reimbursement  amount  will  be  based  on  the  unfulfilled 

'%  potion  of  the  commitment(s)  incurred  Misconduct  is  any  separation  effected  as  a  result  of  action  initiated  under  Air 

Foi.e  directives  governing  substantial  duty  performance  (when  determined  to  be  within  the  member  s  coritrof). 
un*  ccepiabie  conduct,  moral  or  professional  de»ehr tion.  o»  m  the  interest  of  national  security  This  includes  sentence  by 
court  martial  or  separation  »n  lieu  of  court  martial  ) 


(4)  Only  the  Secretary  of  the  Air  Force  or  designee  may  excuse  me  from  m,  obligation  to  serve  on  aciive  duty  for  the  period 
specified  in  this  agreement 


(5)  A  final  decree  of  discharge  m  bankiupicy  under  title  1 1.  Unued  States  Code,  i!  obtained  within  a  period  of  five  years 
;*  „  after  the  last  day  of  the  specified  period  which  i  had  agreed  to  serve,  will  not  release  me  from  my  obligation  to 

reimburse  the  United  States  as  specified  m  this  agreement 


*  G.  f  must  Serve  a  minimum  of  four  years  of  active  duty  from  the  date  of  my  entry  on  active  duty  as  a  commissioned  officer.  O'  if 
’  selected  for  pilot  or  helicopter  training,  eight  years  from  the  date  of  award  of  aeronautical  rating  as  a  pilot  or  helicopter  pilot. 
—  o#  if  selected  for  navigator  framing,  five  years  from  the  date  of  award  of  aeronautical  rating  as  a  navigator 


•H.  Upon  completion  of  training.  I  will  accept  an  appointment  as  an  officer  in  the  Air  force,  if  offered 


I.  If  when  l  am  qualified  for  such  consideration,  i  am  consideied  lor  a  Regular  An  force  appointment,  arid 


(1 )  A  Regular  Air  force  appointment  is  tendeied  and  i  do  not  accept  •  may  be  subieci  to  involuntary  separation  based  on  the 
*  need!  of  the  Air  force  and  current  policy 


(2)  If.  after  I  accept  a  Regular  All  force  appointment.  I  desire  to  resign  my  commission  and  be  separated  from  active  duty.  I 
’  must  tender  my  resignation  under  appropriate  directives  My  separation  will  be  contingent  on  acceptance  of  my 
~  a.-  .  resignation  by  the  Secretary  of  the  An  force  and  may  also  be  contingent  upon  my  accepting  a  Reserve  appointment  if  t 

♦  ^  have  not  yet  fulfilled  my  military  service  obligation 


If. I  I  CERTIFY  THAT  THI  FOREGOING  ENTRIES  ARC  TRUE.  CORRf  CT.  AND  COMPIE  TE  TO  THE  BEST  OF  MY  KNOWLEDGE  AND  BELIEF 


jrtrt. 


ff 


rtf 


rtf 


rtf' 


TYP1D  NAME  AND  GRADE  01  APPLICANT 


' 14  Dec  89 


1  understand  as  an  Air  Force  officer  I  may  be  required  to  train  and 
exercise  control  of,  to  include  actual  release  of,  nuclear  weapons  in 
support  of  the  nuclear  policy  of  the  United  States. 
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I  am  submitting  my  application  with  the  understanding 
that  l  am  age  critical  and  that  if  selected  and 
physically  qualified  1  must  enter  OTS  early  enough 
to  follow  on  and  enter  UPT  prior  to  27.5  years  of  age. 
If  the  Air  Force  is  unable  to  place  me  in  the  OTS  class 
to  facilitate  the  same,  my  selection  as  a  pilot  would 
be  withdrawn. 


EVALUATION  OF  COMMISSIONING  APPLICANTS 


AUTHORITY  10  U  S  C  S91 .  Reserve  Components  Oushhcstrons,  10  US  C  MU.  Crtsbfnhment  end  Purpose  of  Schooh  snd  Csmps 

PURPOSC  To  determine  quehficstiom  for  treirung  leading  to  a  commission  of  OWicff  fr strung  School  ( OT$ )  snd  Airmsn  Csrty  Commissioning 
Progrsm  (AtC?)  spphtsntl  To  determine  qushfKstions  lot  d>r*a  appointment  of  USAfP  semen  not  on  *rt  ended  octree  Chrty  (CAD)  end  An  Pet ere* 
Tethruaens  (APT) 

ROUTINE  USCS  None  fvrntthing  information  rj  vo hmtery  fsilur*  to  futruth  information  may  r  fluff  m  derust  of  confederation  for  tr strung  feeding  to 
s  commission  or  dnect  sppomtment 


Public  reporting  burden  for  thn  collection  r%  estimated  to  verage  20  mmgtes  per  response,  including  the  time  for  reviewing  instructions,  searching 
data  souces.  gathering  and  maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information  Send  comments  regarding 
tms  burden  estimate  or  any  other  aspect  of  this  collection  of  information,  including  suggestions  for  reducmo  this  burden,  to  Washington 
Headquarters  Services.  Directorate  lor  information  Operations  and  Reports.  12i$  ;efferson  Davn  Highway.  Surte  1204.  Arlington  VA  22202-4302.  and 
to  the  Office  of  Management  and  Budget.  Paperwork  Reduction  Protect  (0701*0104).  Washington  DC  20S03 


I.  APPLICANT'S  PERSONAL  DATA  (Appfrcam  must  complete.  Print  mink  end  ttsy  wrtfun  the  linet )  _ 


1.  NAMi  flan.  Frnt.  Middle)  I.  SSN 


4.  DATt  OF  SflTH 
(YYMtJOD) 


gf. 


aaiEScnspaanigEKam  »» 


/W.T-l-J 


ihcluoe  Zip  to or  and  area  code  I  (Military  ,  I  IA.  I 


errs 


7  EDUCATION  AND  EXPERIENCE 


SURJECT 


A.  NAME(S)ANOOATE(SIOE  SCHOOL(S) 


•  SURJECT  MAJOR/MINOR 
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CHAPMAN  ASSOCIATES 

60  Second  Street 
Pott  Office  Box  953 
Shalimar,  Florida  32579 
904/651-3443  •  Fax  904/651-4648 


2  November  1989 


To:  OTS  Selection  Board 


Subject: 


Letter  of  Recommendation  for 


I  am  a  retired  Air  Force  General  Officer  with  direct  personal  knowledge  of 
and  his  family. 

I  wholeheartedly  recommend  thatHmj^^Hbe  selective  for  OTS  followed  by  pilot 
training  with  the  ultimate  objectiveofanF^l^or  F-16  flying  assignment. 

1  do  not  have  enough  golden  words  to  adequately  describe  the  absolutely  superior 
qualifications  of  this  fine  young  man.  He  is: 

The  son  of  an  outstanding  Air  Force  Officer. 

An  outstanding  student  (National  Dean’s  List). 

An, accomplished  pilot  (8  different  civilian  aircraft). 

A  highly  moral  and  ethical  man. 

A  superb  athlete  including: 

-  Quarterback  and  punter 

-  Baseball  pitcher 

*  Basketball  player 

-  Skier 

-  Tennis  player 

The  Air  Force  will  benefit  significantly  from  sending  this  fine  young  man  to  OTS  and 
UPT.  Mark  him  well  -  he  will  someday  be  a  general  officer. 


Sincerely, 


Robert  E.  Chapman 

Brigadier  General,  USAF,  Retired 
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Bill  G.  Carter 

Sirtir  Rff>»t»rntaiiv< 
Dismn  91 

Committees: 

(.'oTTffiioni, 

Vice  Chniiman 
Tranjporidtion 


Aujim  Office 
PO  Box  2910 
Austin,  Texas  78769 
$12-46)  0482 

Diitrin  Office 

7001  Gtafwnn,  Hvj ,  Suite  M 
Ft  Worth.  Texas  76180 
617  595  007 2 


TO: 

REF: 

DATE: 


Officer  Training  School 
Election  Board 

Letter  of  Recommendation  for 
November  10,  1989 


Please  accept  thislette^s  my  personal  endorsement 
on  behalf  as  a  worthy  candidate 

for  the  U.S.A.F.  Officer  Training  School. 

I  truly  feel  he  would  serve  as  an  outstanding  candidate 
and  would  prove  to  be  an  asset  to  our  country. 

After  reviewing  his  resume  I  think  you  will  agree  that 
he  has  devoted  a  lot  of  time  and  effort  on  his  endeavors 
and  feels  very  strong  about  his  career  with  the  Air 
Force.  With  the  dedication  he  has  expressed  I  feel  he 
should  be  given  the  opportunity  to  expand  and  better 
his  career. 


Thank  you  in  advance  for  any  consideration  you  can  give 
WKKM  during  your  selection  process.  In  the  meantime, 
pBrefa^e  feel  free  to  call  if  you  should  require  additional 
information  or  if  I  can  be  of  service. 

Sincerely , 


/$cU 


Bill  G.  Carter 
BGC/ar 

cc:  Senator  Phil  Gramm 

Congressman  Pete  Geren 
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12925  Jasoncrest  Trail 
Dallas,  TX  75243 
10  November  1989 


TO:  OTS  Selection  Board 


Dear  Sirs, 


Terry  has  expressed  to  me  his  desire  to  become  an 
Officer  and  pilot.  I  know  that  this  means  a  great 


Air  Force 
deal  to  him. 


I  have  observed  J^J^as  he  grew  from  childhood  to  a  young  man. 

As  a  retired  Air  Force  Officer  and  pilot,  I  feel  qualified  to 
judge  young  men  on  their  suitability  as  officer^nd  pilots:  and 
I  can,  without  reservation,  report  that^HH^^HHHJTpossesses 
just  the  ouaUties  that  the  Air  Force  expects  in  its  officers  and 
pilots.  an  intelligent,  vital  young  man  with  the 

integr ityand  dedication  to  become  an  important  contributor  as  an 
officer.  He  possesses  the  judgement  and  sharp  reflexes  that 
would  make  him  a  valued  addition  to  the  pilot  ranks. 


should  be  accorded  entrance  to  the  OTS  and  UPT  courses  as 
soon  as  possible. 


Sincerely, 

Dub^D.  Todd 
Major,  USAF  (Ret) 
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TO:  OTS  Select  Jon  Board 
SUBJECT:  Letter  of  Reference 

FROM:  Robert  McFadden  October  30,  1989 


1  have  known for  fourteen  years.  During 
that  time,  I  have  seen  him  grow  from  a  pre-teen  with  a 
burning  desire  to  fly  to  a  mature  adult  ,^/ith  that  same 
burning  desire  tc  fly.  !  Lave  counse !  ed  about  the 

positive  and  negative  aspects  of  a  flyln^career  In  both 
the  military  and  the  civilian  aviation  communities.  From 
1969  to  1977,  1  was  an  Air  Force  instructor  pilot  for  ATC 
and  a  research  pilot  for  AFSC.  Since  1978,  I  have  been  a 
commercial  airline  pilot.  Having  been  In  both  worlds,  I  know 
what  It  takes  to  succeed  In  the  aviation  career  field. 


■Vwl  1  1  succeed  in  his  quest  to  fly  because  he  has 
what  M^taKes.  After  a  great  deal  of  consideration  and  after 
long  periods  of  selecting  a  career  path,  he  has  chosen  the 
Air  Force.  He  has  all  the  qualities  necessary  to  be  an  Air 
Force  officer.  He  is  dedicated,  goal -or iented,  organized, 
and  assei^ve.  He  Is  Intelligent,  stable,  and  attentive  to 
^etal  1  •  J|Hfhas  natural  coordination  demonstrated  over  the 
years  tnrougn  consistent  athletic  success  and  flight 


Force  officer, 
and  assertive, 
deta  . 
years  tnrougn 


accompl Ishments. 


I  whole-heartedly  support  JH^^I^^cho i ce  to  Join  the 
ranks  of  the  Air  Force  officer  group.  I  am  particularly 
proud  he  chose  the  Air  Force  since  my  memories  of  the  time 
spent  I n  the  military  are  fond  memories.  I  highly  recommend 
be  selected  for  the  USAF  Officer  Training  School, 
ou  will  not  find  a  better  or  more  well -suited  candidate. 


S  0 

Robert  W.  McFadden 
Formerly  Capt . ,  USAF 
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OBJECTIVE  To  become  an  United  States  Air  Force  career  officer 
WORK  EXPERIENCE 

1989  Flight  instructor  free-lance  for  60  hours 
1983-1988  General  maintenance  duties  at  an  apartment  complex 
TRAINING  AND  OTHER  EXPERIENCE 

Commercial  aviation  with  Ari  Ben  Aviator.  Flight  instructor  with 
American  Flyers.  Certified  flight  instructor,  certified  flight 
Instructor  instruments  and  multi-engine  flight  instructor. 

Civil  Air  Patrol  Lubbock  Chapter  for  two  years.  Checked  out  in  eight 
civilian  aircraft  with  a  total  of  356  hours. 

EDUCATION 

Graduated  from  Texas  Tech  University  in  1988  with  a  BS  degree 
in  Biological  Science  and  a  minor  in  Psychology,  hade  the 
National  Dean's  List  in  1983,  Dean's  List  in  1983  and  the  Dean's 
Honor  Roll  in  1982  and  1983. 

ORGANIZATIONS 

ALPHA  PHI  OMEGA  National  Service  Fraternity.  Involved  in  many 

service  activities  Including  blood  donor  drives. 

KO  SARI  5ocial  Fraternity.  An  elected  officer. 

College  Constitutional  Revision  Committee 

Civil  Air  Patrol,  Second  Lieutenant,  pilot,  Lubbock,  Texas  Chapter 
Boy  Scouts  of  Amer i ca 
Trident  Society 
Medical  Explorers 

ATHLETICS 

High  School  Baseball  -  P i tcher / 1 nf i e 1 der ,  All  Star  Teams, 

Two  Varsity  Letters 

Football  -  Team  Captain,  Quarterback,  All-City 
Punter,  Two  Varsity  Letters 
Basketball-  Guard  and  Forward,  Two  Varsity  Letters 
Track  -  400  Meters,  400  Meter  Relay,  1600 

Meter  Relay,  One  Varsity  Letter 
College  Intramural  Football,  Basketball,  Volleyball 

PERSONAL 

Age:  26  Weight:  185  Height:  6'2"  Marital  Status:  Single 
Hobbles:  Jet  Skiing  and  Snow  Skiing 

Other:  Son  of  a  Lieutenant  Colonel,  USAF ,  Retired  (Regular 

Air  Force) 
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FLIGHT  TIME  WORKSHEET 


« 


TYPE 

houf/s 

HOURS 

Dual 

J  21 _ 

Pilot 

in  Command 

_2£Q. _  - 

Cross 

Country 

_2.Q7 _ 

Ni  ght 

1 _ 

Hood 

__42 _ 

Instrument 

_ L2 _ 

Sol  o 

__26 _ 

Total 

time  -  Single  engine  land 

_2£2 _ 

Total 

time  -  Multi  engine  land 

__22 _ 

Total 

time  -  Other 

2  _  _ 

Total 

Flight  Time 

2£2 _ 

TYPE  OF 

AIRCRAFT/HOURS 

1  31^35-1-  92_hr  s.  4  _P_A_-_2_8_  J_  _4_0_  hr_s_-_ 

2  i»Ar 33-  7J07_hrs^  5  _Q_-JAL  V_  _3_2_  itfJL-  _ 

3XL-J JX  A  5  7_  h  r  6 JL-JJJttfi/JlA.  JurJL-_ 


RATINGS 


1  _£2ITII'§Eci  a  1 _  4_I_ns  truraent _ 

2_5iDaiezeaaiiie. 5Jii2i!AIr*iixy£i2i. 

3_lmiiir£Dgine _ 

I  certify  that  the  above  •flight  times,  aircraft  type  and  ratings  are 
correct  to  the  best  of  my  fnowl edge. 


Date 


12 


BS-Biology 


0044XA47U 


GRADE  POINT  AVERAGE  (GPA)  WORKSHEET 


•  TlNST  KAMI  MlDOtl  H*Mt 


I.  COMPUTING  Tim  GPA 


INSTRUCTIONS  Utt  the  4  point  system  Cw2.  D-l.  anu  F»0).  Using  APR  35  25.  convert  quarter  hours  tn  semester  hUun  (one  quarter  hour 

equals  rwothtrds  of  one  semester  hour).  Include  credit  houn  and  Quo'ity  points  for  all  courses  laken  where  a  grade  was  rtcehad  For  Incomplete?  use  an  "F“ 
as  the  grade  awarded.  If  counts  wen  retaken.  figure  both  grades  into  the  average.  On  not  Include  credit  hours  or  quality  points  for  withdrawals,  courses 
that  were  audited,  or  pass-fall.  Lin  each  college  or  university  separately,  total  columns  (b)  and  ( c ).  then,  divide  the  total  of  column  (bf  by  the  total  of  column 
(c)  to  determine  the  cumulative  GPA.  _  . 


NAME  OY  INSTITUTION 

(•) 


TOTAL  CKIDIT  HOUAI 

fb/ 


TOTAL  QUALITY  POINT! 

(Cl 


Texas  Tech  University 


McMurray  College 


TOTAL 

133 

376 

CUMULATIVE  OAA  * 

133  *>.  376  .  2.82 

(total  column  (b/l  ( total  column  ( c) ) 

INS  TR  t'CT/ONS  Compute  the  technical  grade  point  owroge  (courses  token  within  the  motor  stud y  area i  for  engineering  and  meteorology  applicants  List  each 
college  nr  univentry  separately .  total  columns  ft)  and  (cl  then ,  divide  the  total  of  column  fb /  hy  the  total  of  column  (ci  to  determine  the  cumulonvt  GPA 

NAME  OE  INSTITUTION 

(•) 

TOTAL  C»tOIT  NOUNS 

<b) 

TOTAL  QUALITY  POINT! 

(C) 

CUMULATIVE  TECHNICAL  0»A  , 


-  -  ■  divided  bv _ __ 

fmtal  column  fb))  column  / c)f 


Ml.  C'l  PTII  ICATIO^  Ho  be  completed  h>  a  ba%c  education  office  official  01  PecruHini^Strvicr  Officer  only  ) 


o»r,c,«u  WAS SERMAN. MARK  P. 
CAPT.USAF.3544TH  USAFRSO 
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TEXAS  TECH  UNIVERSITY 


74 


75 


ADMISSION  Kl  <  OKI) 


l.uli,’°ck.(:iitisLiaii  IU c 1  >  School  Lubbock.  Tin 

I  ..oil  '  *H  Altm.N.1 


8-8  2  _ 

(Ml«  O*  «  •«  «d  •!>»*< 


. . I»l«-  HI  . 


§  _20_r/  17  55  20  ns  26  COmp  21  Vc. h.n 

AM  *  r./V  I  Sill 


COllfil*  Atl»nf|r>| 


TnAUDCniPT  INFOnMATlON 
mwo  svr.itM  Gi«im  «m*<i  m  r« 

A  F»r*4UvH  H  f«n<v1  C 
f  wr  I  W>r~ 


i, -hr  si*-'  llo» (.m***  I  i  k*»  *<■<"*  no 

[I  rMH  Pn>*« |  r»»IMy)  Sv«»f**>  »»  *nrt  *'*rSl 

'■.fMCSTtn  £<«.»**•«  «■****  s**nww<-  S,»  We«4i  tucH 


SfMrSlfO  MOUW  0»  N»ir  ^  n>  «<*o  10 

frmi  It. him  ri>  l*rm»«»n»v  P«-  <— »*  l«v  OMf  Y»w«i" 

NUMUfOING  SVSTIM  F»*»  ftw 

•«  »4»f  h  t»»w  n  W**"  TW  ancwt  <*g"  r*rWe»<»i 

»mrwc*ig»  )n«  c’wfri  «4  (m*tt  th*  iNrt)  and  loiprti 

ten  »**  •MtewfctfJ  com*** 


RECORD  OF  COLLEGE  WORK 


3  3  1? 

1?  u.oiboi) 


CmirieNi).  nrscmmvr  imrof  couhm 

P  £  M23R3  OFF-SEASON  CONUlT'NK 

3  3  12  A.onoo  3  3 

PSYC  2  36  9  neveloomental  Ps vc 

HF  1100  Fitness  tor  Living 

ENG  1310  Freshman  Writing 

PSYC  2340  Intro  to  Psychology 

10  10  39,  3.9000  13  13  51 

Dean  s  Honor  Roll  Fall  1982 


ENG  1320  Comp  L  Literary  Form  3 

PSYC  4395  ^Directed  Studies  3 

PSYC  4310  Experimental  Psyc  3 

CSC  1399  Intro  to  Computer  Science  3 

HF  1150  T  enni s  1 

13  13  49  3.7692  026  026  100  3.E46 

Dean's  List  Spring  1983 


HF  1160  Aerobics./  Rhythms 

.MATH  1311  Algebra 

■CHEM  1410  General  Chemistry  I 

P  1  0  L  1401  Friri  of  Piology 

09  09  28  3.1111  035  035 


.1,'  |5.-m  j. 

I'"'  . 

•r»i.  f"oo*p. 


Scm.  Grades 

i  !  t _ 


MAY  82 


4  A 
0  UF' 
12  F 
12  P 


SPR  83 
SPP  83 
SPR  83 
SPR  83 
SPR  83 


FAL  B3 
FAL  83 
FAL  83 
FAL  83 


ART  1300  Exploring  Visual  Art  3  3  12 

MATH  1312  TriSor,on.etr«  0  0  0 

P10L  1403  Zoology  000 

03  03  12  4.0000  038  038  140  3.6842 

HARD IN- SIMMONS  UNIVERSITY 

MIL  SCI  2304  Wilderness  Skills  339 

:  06  06  21  3.5000  041  041  149  3.63U 

I  -  ,  HcMURRY  COLLEGE 

|  Dean's  Honor  Roll  Spring  1984|  I  I  r  .  I 


n  ,  U 


A  SPR  84 
UP  SPR  84 
UP  SPR  84 


B  SPR  84 


"’MO:  r  (iltf  Iirv.ii  i|.jU^r 
1  1  ■'  ‘D  •*!..■  1 MU..1  I  'J6K  I  ML 

•;  0 


★  Creative  Counseling  Worksliops 


DEGREE  CONfERPED 


"  '  •  L'M  lA'V  V 


TJ 

PI 

1  f  o 
fi  3  r 

H  V  M 

£  pi  L. 
5  O  W 

2  o  \ 

£  »  VJ 

£  O  Hi 


Appendix  C:  Board  Score  Frequencies 
(Total ) 


BDTOT 

Frequency 

Percent 

Cumulative 

Frequency 

Cumulativ 

Percent 

7 . 5 

1 

0.0 

1 

0 . 0 

8 

3 

0.0 

4 

0.0 

8 . 5 

2 

0 . 0 

6 

0.1 

9 

4 

0. 0 

10 

0.1 

9 . 5 

1 

0.0 

11 

0 . 1 

10 

2 

0 . 0 

13 

0 . 1 

10.5 

8 

0.1 

21 

0 . 2 

11 

12 

0.1 

33 

0.4 

11.5 

10 

0.1 

43 

0.5 

12 

16 

0.2 

59 

0.6 

12 . 5 

31 

0.3 

90 

1.0 

13 

45 

0.5 

135 

1.5 

13 . 5 

53 

0.6 

188 

2 . 0 

14 

81 

0.9 

269 

2.9 

14 . 5 

83 

0.9 

352 

3 . 8 

15 

132 

1.4 

484 

5.3 

15.5 

158 

1.7 

642 

7 . 0 

16 

410 

4 . 4 

1052 

11.4 

17 

506 

5.5 

1558 

16.9 

18 

643 

7.0 

2201 

23.9 

19 

690 

7.5 

2891 

31.4 

20 

871 

9.5 

3762 

40.8 

21 

763 

8 . 3 

4525 

49 . 1 

22 

825 

9 . 0 

5350 

58 . 1 

23 

950 

10.3 

6300 

68 . 4 

24 

896 

9.7 

7196 

78 . 1 

2  Z 

757 

8 . 2 

7953 

86 . 3 

26 

569 

6.2 

8522 

92 . 5 

27 

307 

3 . 3 

8829 

95 . 8 

28 

118 

1.3 

8947 

97 . 1 

29 

30 

0 . 3 

8977 

97.4 

30 

238 

2 . 6 

9215 

100. 0 

77 


Board  Score  Frequencies  (Pilot) 


BDTOT 

Frequency 

Percent 

Cumulative 

Frequency 

Cumulativ 

Percent 

9 

1 

0.0 

1 

0.0 

10.5 

1 

0. 0 

2 

0.1 

12 

1 

0.0 

3 

0. 1 

12 . 5 

2 

0.1 

5 

0 . 2 

14 

3 

0.1 

8 

0 . 3 

14 . 5 

8 

0.3 

16 

0 . 7 

15 

11 

0.5 

27 

1 . 2 

15.5 

15 

0.6 

42 

1 . 8 

16 

47 

2 . 0 

89 

3 . 8 

17 

94 

4 . 0 

183 

7 . 8 

18 

149 

6.4 

332 

14 . 2 

19 

171 

7.3 

503 

21 . 5 

20 

194 

8.3 

697 

29 . 8 

21 

194 

8 . 3 

891 

38 . 1 

22 

225 

9.6 

1116 

47 . 7 

23 

272 

11.6 

1388 

59 . 4 

24 

265 

11.3 

1653 

70.7 

25 

279 

11.9 

1932 

82 . 6 

26 

203 

8.7 

2135 

91.3 

27 

93 

4 . 0 

2228 

95.3 

28 

40 

1.7 

2268 

97 . 0 

29 

10 

0.4 

2278 

97 . 4 

30 

60 

2 . 6 

2338 

100. 0 

78 


Board  Score  Frequencies  (Navigator) 


Cumulative  Cumulative 

BDTOT  Frequency  Percent  Frequency  Percent 


8 

2 

0.2 

2 

0 . 2 

10.5 

1 

0.1 

3 

0.2 

11.5 

1 

0.1 

4 

0.3 

12.5 

2 

0.2 

6 

0.5 

13 

3 

0.2 

9 

0.7 

13 . 5 

2 

0.2 

11 

0.9 

14 

5 

0.4 

16 

1 . 3 

14 . 5 

10 

0.8 

26 

2 . 1 

15 

15 

1.2 

41 

3 . 4 

15.5 

13 

1.1 

54 

4 . 4 

16 

44 

3 . 6 

98 

8 . 0 

17 

68 

5 . 6 

166 

13 . 6 

18 

81 

6.6 

247 

20.3 

19 

89 

7 . 3 

336 

27 . 6 

20 

117 

9 . 6 

453 

37 . 2 

21 

114 

9 . 4 

567 

46.5 

22 

126 

10.3 

693 

56.8 

23 

147 

12 . 1 

840 

68 . 9 

24 

154 

12.6 

994 

81 . 5 

25 

109 

8.9 

1103 

90 . 5 

26 

47 

3.9 

1150 

94 . 3 

27 

34 

2.8 

1184 

97 . 1 

28 

15 

1.2 

1199 

98 . 4 

29 

1 

0.1 

1200 

98.4 

30 

19 

1.6 

1219 

100 . 0 

79 


Board  Score  Frequencies  (Non-rated  Operations) 


BDTOT 

Frequency 

Percent 

Cumulative 

Frequency 

Cumulat iv 
Percent 

8 . 5 

1 

0.1 

1 

0. 1 

9.5 

1 

0.1 

2 

0. 1 

10 

1 

0.1 

3 

0 . 2 

10.5 

4 

0.2 

7 

0.4 

11 

1 

0.1 

8 

0 . 5 

11.5 

1 

0.1 

9 

0.6 

12 

6 

0.4 

15 

0.9 

12 . 5 

10 

0.6 

25 

1.5 

13 

14 

0.9 

39 

2 . 4 

13 . 5 

13 

0.8 

52 

3 . 2 

14 

24 

1.5 

76 

4 . 7 

14 . 5 

26 

1.6 

102 

6 . 3 

15 

37 

2 . 3 

139 

8 . 6 

15.5 

36 

2 . 2 

175 

10.8 

16 

113 

7 . 0 

288 

17 . 8 

17 

122 

7 . 5 

410 

25. 3 

18 

131 

8 . 1 

541 

33 . 4 

19 

120 

7.4 

661 

40.8 

20 

168 

10.4 

829 

51.2 

21 

129 

8 . 0 

958 

59 . 2 

22 

131 

8.1 

1089 

67 . 3 

23 

148 

9 . 1 

1237 

76 . 4 

24 

127 

7 . 8 

1364 

84 . 2 

25 

97 

6.0 

1461 

90 . 2 

26 

84 

5.2 

1545 

95.4 

27 

40 

2.5 

1585 

97 . 9 

28 

16 

1.0 

1601 

98 . 9 

29 

4 

0.2 

1605 

99. 1 

30 

14 

0.9 

1619 

100 . 0 

80 


Board  Score  Frequencies  (Technical) 


Cumulative  Cumulative 


BDTOT 

Frequency 

Percent 

Frequency 

Percent 

11 

7 

1.2 

n 

1.2 

11.5 

1 

0.2 

8 

1.4 

12 

1 

0.2 

9 

1 . 6 

12 . 5 

4 

0.7 

13 

2 . 3 

13 

5 

0.9 

18 

3 . 2 

13.5 

8 

1.4 

26 

4 . 6 

14 

8 

1.4 

34 

6 . 0 

14.5 

6 

1.1 

40 

7 . 0 

15 

9 

1.6 

49 

8 . 6 

15.5 

17 

3.0 

66 

11 . 6 

16 

25 

4 . 4 

91 

16 . 0 

17 

19 

3 . 3 

110 

19 . 3 

18 

40 

7 . 0 

150 

26.4 

19 

34 

6.0 

184 

32 . 3 

20 

58 

10.2 

242 

42 . 5 

21 

33 

5.8 

275 

48 . 3 

22 

50 

8.8 

325 

57 . 1 

23 

51 

9.0 

376 

66.1 

24 

51 

9.0 

427 

75.0 

25 

34 

6.0 

461 

81.0 

26 

32 

5.6 

493 

86 . 6 

27 

10 

1.8 

503 

88.4 

28 

6 

1.1 

509 

89 . 5 

29 

1 

0. 2 

510 

89 . 6 

30 

59 

10.4 

569 

100.0 

81 


BDTOT 

Frequency 

Percent 

Cumulative 

Frequency 

Cumulative 

Percent 

7 . 5 

1 

0.0 

1 

0.0 

8 

1 

0.0 

2 

0.1 

9 

3 

0.1 

5 

0 . 2 

10.5 

2 

0.1 

7 

0.3 

11 

3 

0.1 

10 

0.4 

11.5 

5 

0.2 

15 

0 . 6 

12 

5 

0.2 

20 

0 . 8 

12 . 5 

13 

0.5 

33 

1.3 

13 

20 

0.8 

53 

2  1 

13  ■  5 

24 

0.9 

77 

3 . 0 

14 

31 

1.2 

108 

4 . 3 

14 . 5 

23 

0.9 

131 

5 . 2 

15 

41 

1.6 

172 

6 . 8 

15 . 5 

65 

2 . 6 

237 

9 . 4 

16 

140 

5.5 

377 

14 . 9 

17 

155 

6 . 1 

532 

21.0 

18 

176 

7.0 

708 

28 . 0 

19 

212 

8.4 

920 

36.4 

20 

246 

9.7 

1166 

46.1 

21 

230 

9.1 

1396 

55 . 2 

22 

225 

8.9 

1621 

64 . 1 

23 

225 

8.9 

1846 

73.0 

24 

203 

8 . 0 

2049 

81.0 

25 

146 

5.8 

2195 

86. 8 

26 

142 

5.6 

2337 

92 . 4 

27 

96 

3 . 8 

2433 

96 . 2 

28 

27 

1. 1 

2460 

97 . 2 

29 

10 

0.4 

2470 

97 . 6 

30 

60 

2 . 4 

2530 

100 . 0 

82 


(Navigator) 


Plot  of  BDTOT*PREDBD .  Legend:  A  =  1  obs,  B  =  2  obs,  etc. 

Actual 


30 

+ 

I 

A  A 

29 

i 

+ 

l 

28 

I 

+ 

i 

A 

A 

27 

I 

+ 

i 

A 

BAA 

26 

I 

+ 

i 

A 

A  AAAB 

25 

i 

+ 

i 

A  AAB  A 

D  A 

A  B  B 

24 

i 

+ 

I 

A 

AB  A 

AACAC  A 

A 

BA  A  A 

23 

I 

+ 

i 

A  A 

AA 

B  C 

BA  BA 

A  AA 

22 

I 

+ 

I 

A  A 

AA  A 

A 

AB 

B  A 

21 

I 

+ 

i 

B 

A  A  A  A 

A  BA 

A 

A 

A 

20 

I 

+ 

I 

A 

AAAAA 

BA 

BAA 

19 

i 

+ 

i 

A  AAAA  A 

A 

A 

18 

l 

+ 

i 

A 

B  AA 

AA  A 

A  A 

A 

17 

1 

4* 

l 

AA 

A 

B 

A 

7\ 

n 

16 

i 

+ 

i 

A 

A 

AA  A 

15 

i 

+ 

i 

A 

A  B 

14 

1 

4- 

1 

A 

— 

i 

_ + _ 

— 

—  + _ 

- 1 - 

-+- 

- +  _ 

16 

18 

20 

22 

24 

Predicted 
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Predicted  vs  Actual  Board  Scores  (Non-rated  Operations) 


Plot  of  BDTOT*PREDBD .  Legend:  A  =  1  obs,  B  =  2  obs ,  etc. 


Actual j 

28 . 0 

i 

+ 

A  A 

27 . 5 

+ 

27. 0 

+■ 

AA  A 

26.5 

+ 

26 . 0 

+ 

A 

A  B  A  A  B  A 

25 . 5 

+ 

25.0 

+ 

A  A 

A  AAAAAA 

24 . 5 

+ 

24 . 0 

+ 

AA  A 

A  AA  AA  BA 

23 . 5 

+ 

23 . 0 

+ 

A 

AA  A  B  C  BAA 

22 . 5 

+ 

22 . 0 

+ 

A 

B  ABB  A  AA  A  AA  B  A 

21.5 

+ 

21.0 

+ 

A 

A 

A  B  ABAA  A  A 

20.5 

+ 

20.0 

+ 

A  A 

B  AA  BAA  AA  A  AA  A 

19 . 5 

+ 

19.0 

+ 

A  A 

AAA 

CABA  BA  A 

18 . 5 

+ 

18 . 0 

+ 

A 

AB  A 

AAB  AAA  B  A 

17 . 5 

+ 

17 . 0 

+ 

A 

A 

A  AAAA  CA  ABA 

16.5 

+ 

16.0 

+ 

A 

A  A 

AA  A 

B  A  A  A  A 

15 . 5 

+ 

A 

A  A 

A  A 

15.0 

+ 

A  A 

A 

14 . 5 

+ 

A 

14 . 0 

+ 

AA  A 

13 . 5 

+ 

A 

A 

13 . 0 

+ 

12 . 5 

+ 

12 . 0 

+ 

11.5 

+ 

A 

11.0 

+ 

10.5 

+ 

10 . 0 

+ 

A 

9 . 5 

+ 

9 . 0 

+ 

8 . 5 

+ 

A 

A  A 
A 


A  A 


+ - + - + - + - + - + - +  - 

16  18  20  22  24  26 
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Predicted  vs  Actual  Board  Scores  ("Technical) 


Plot 

of 

BDTOT*PREDBD.  Legend: 

A  =  1  obs,  B  : 

=  2 

obs , 

Actual j 

30.0 

i 

4 

A  ABA 

A 

AA 

29 . 5 

4 

29.0 

+ 

28 . 5 

4 

28 . 0 

+ 

A 

27 . 5 

+ 

27.0 

4- 

A 

26.5 

4 

26.0 

4 

A  A  A 

A 

25.5 

+ 

25. 0 

4 

A  A 

A 

A 

A 

24 . 5 

4 

24 . 0 

4 

A  BAAA 

AA 

23 . 5 
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Plot  of  BDTOT*PREDBD.  Legend:  A  =  1  obs,  B  =  2  obs, 
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Appendix  E:  Residual  Plots 
(Navigator) 


Plot  of  YRESID*YHAT .  Legend:  A  =  1  obs,  B  =  2  obs,  etc 
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Residual  Plot  (Non-rated  Operations) 
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Plot  of  YRESID*YHAT.  Legend:  A  =  1  obs,  B  -  2  obs,  etc 
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Residual  Plot  (Technical) 


Plot  of  YRESID*YHAT.  Legend:  A  =  1  obs,  B  =  2  obs, 
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Residual  Plot  (Non-technical ) 


Plot  of  YRESID*YHAT .  Legend:  A  =  1  obs,  B  =  2  obs,  etc. 

i 

I 

15  +  A 

i 


i 

10  + 


i 


i 

5  + 

i 


R 

e 

s 

i 

d 

u 

a 

1 


i 

o  + 


i 


i 

-5  + 


-10 


i 

+ 

i 


A 

B 

A 

B  A 

C  A  AAAA 
AAB  A  CA 
A  B  BACBBCBB  A  GC 
A  A  AAAAC  DEFBFA  A  GJ 

A  B  AAFDAGAFJAKBBB  CHA 
AAE  FJBFBIBCMDLEMGADAA  ED 
A  C  A  CDHAGNCLGJI JPBJIB  AAA  A 

AAA  AFCHHFJEMPHVDRGMKBGACA 
B  DAAMCNKHKFMHPQIICHEDCAD 
AA  ACCA  FDHQHNEJPPJJZ JFKECAA  A 

EABDCMDOKLQCSIPSJHEKCCEAB 

- A — A-BCFBRBELEQFWTITFPOFEAGAC - 

A  AA  BBDDEGFKDNJHWGREKMDLCEBBAA  A 
A  B  ABLCDHHLNESIPSGKIMHBDAB 
AAB  A  DCFJGLBPKKYCQHKDEF  DAAB  A 
DACCCAELKMJGPCNLJHEEBACAABA 
CAAABFLJLCKDGIEIFEGBA  A  A 
A  A  BA  EDAFENUCLBKCFC  DAA 
A  ECDCEEKGAJ  BBBBBB 
A  AC  DCECADAEGBEDBC  BAA 
A  BC  C  CBCDBCA 
A  BAABABDAA  A 
A  AA  BBABAAB  A 

A  B  B  AA  A 

A  A  A 

A 
A 

A 

A 


-+ - + - + - + - (- 

10  15  20  25  30 

PrpHi  ^  \  of  ROT^T 


90 


Appendix  F:  Log  Transformation  Regression  Results  (Technical) 


Analysis  of  Variance 


Sum  of 

Mean 

Source 

DF 

Squares 

Square 

F  Value 

Prob>F 

Model 

6 

33 .39725 

5 . 56621 

36.953 

0 . 0001 

Error 

503 

75.76565 

0 . 15063 

Total 

509 

109 . 16290 

Root 

MSE 

0.38811 

R-square 

0. 3059 

Dep 

Mean 

2 . 14399 

Adj  R-sq 

0.2977 

C.V. 

18 . 10214 

Parameter  Estimates 


Variable  DF 


INTERCEP  1 
GPA  1 
AFOQT_A  1 
AFLYHRS  1 
*PRIVLIC  1 
EVAL1145  1 
*SX  1 


*  Indicator 


Parameter 
Estimate 

3 .834260 
-0.322987 
-0.010400 
0.001714 
-0.412147 
0.016126 
-0.107949 

variables 


Standard 

Error 

0.13721321 
0.03799875 
0 . 00093988 
0.00103042 
0.23476977 
0 . 01062609 
0.04866917 


T  for  HO: 
Parameter=0 

27 .944 
-8 . 500 
-11.066 
1.663 
-1.756 
1.518 
-2.218 


Prob  >  ] T I 

0. nooi 
0.0001 
0 . 0001 
0.0969 
0.0798 
0.1298 
0.0270 


PREDICTION  ERROR 


N 


Mean  Std  Dev  Minimum 


Maximum 


65  0.3327464  0.2943417  0.0265747 


1 .7042250 
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Plot  of  LNBDTCT*PREDBD 
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Residual  Plot  (log  Technical^ 


Plot  of  YRESID*YHAT .  Legend:  A  =  1  obs ,  B  =  2  obs,  etc. 
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>-Q  Plot  (log  Technical' 


Plot  of  RESRANK*YRESID.  Legend:  A  =  1  obs,  B  =  2  obs,  etc. 
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Appendix  G:  0-0  Plots 
(Navigator) 

Plot  of  RESRANK*YRESID.  Legend:  A  =  1  obs ,  B  =  2  obs ,  etc. 
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Plot  of  RESRANK*YRESID .  Legend:  A  =  1  obs,  B  =  2  obs,  etc, 
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o  oc 


0-0  Plot  (Technical) 


Plot  of  RESRANK*YRESID.  Legend:  A  =  1  obs,  B  =  2  obs,  etc 
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P30T)  «Z>5) 


0-0  Plot  CNon-technical ) 


Plot  of  RESRANK*YRESID.  Legend:  A  =  1  obs,  B  =  2  obs, 
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Appendix  H;  Regression  /  Prediction  Error  Results 

(Pilot) 


Analysis  of  Variance 


Sum  of 

Mean 

Source 

DF 

Squares 

Square 

F  Value 

Prob>F 

Model 

11 

8362 . 28321 

760.20756 

99 . 516 

0.0001 

Error 

2326 

17768 .39002 

7. 63903 

C  Total 

2337 

26130.67322 

Root 

MSE 

2.76388 

R-square 

0.3200 

Dep 

Mean 

22 .40676 

Adj  R-sq 

0.3168 

C.  V. 

12 . 33503 

Parameter  Estimates 

Parameter 

Standard 

T  for  HO: 

Variable 

DF 

Estimate 

Error 

Parameter=Q 

P  >  |  T  | 

INTERCEP 

1 

7.869655 

0 . 49950722 

15.755 

0.0001 

APRYRS 

1 

0 . 095546 

0.04513243 

2 . 117 

0.0344 

EVAL1145 

1 

0.173891 

0 . 02640054 

6 . 587 

0 . 0001 

GPA 

1 

2.458751 

0 . 13935426 

17 . 644 

0.0001 

AFOQT  A 

1 

0.027841 

0.00374774 

7.429 

0. 0001 

AFOQT  P 

1 

0.048135 

0.00464340 

10.366 

0.0001 

*PRIVLIC 

1 

0.928378 

0.14141955 

6.565 

0.0001 

AFLYHRS 

1 

0.001146 

0.00023961 

4.782 

0.0001 

*CALC 

1 

0.657326 

0.13311672 

4 .938 

0 . 0001 

*SX 

1 

1.419295 

0.53284456 

2 . 664 

0.0078 

*BACHPLUS 

1 

1.018999 

0.35098340 

2 . 903 

0.0037 

*T 

1 

0.484627 

0.13956775 

3.472 

0.0005 

*  Indicator  variables 


PREDICTION  ERROR 

N  Mean  Std  Dev  Minimum  Maximum 


278  2.1732985  1.6240296 


0.0219902  8.7097845 
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Rearession 

/  Prediction 

Error  Results 

(Naviqator) 

Analysis 

of  Variance 

Sum  of 

Mean 

Source 

DF 

Squares 

Square 

F  Value 

Prob>F 

Model 

11 

5136.32917 

466.93902 

62 . 077 

0 . 0001 

Error 

1207 

9078 .98626 

7 . 52194 

C  Total 

1218 

14215.31542 

Root  MSE 

2.74262 

R-square 

0 .3613 

Dep  Mean 

21.53117 

Adj  R-sq 

0 . 3555 

C.  V. 

12.73789 

Parameter  Estimates 


Parameter 

Standard 

T  for  HO: 

Variable 

DF 

Estimate 

Error 

Parameters 

P  >  |  T  | 

INTERCEP 

1 

5.754312 

0.67939710 

8.470 

0. 0001 

APRYRS 

1 

0.243617 

0.07398384 

3 . 293 

0.0010 

EVAL1145 

1 

0.252113 

0.04320676 

5.835 

0.0001 

GPA 

1 

2.747927 

0. 19680655 

13.963 

0 . 0001 

AFOQT  A 

1 

0 . 044723 

0.00514397 

8 . 694 

0 . 0001 

AFOQT  P 

1 

0.037412 

0 . 00536553 

6.973 

0. 0001 

*PRIVLIC 

1 

2 . 130650 

0.25813735 

8 . 254 

0. 0001 

*CALC 

1 

0.750541 

0.18137081 

4 . 138 

0.0001 

*MINOR 

1 

0.767607 

0.39675364 

1.935 

0 . 0533 

LORS  GEN 

1 

2.035595 

1.13807531 

1 .789 

0.0739 

WAIVS 

1 

-0.495711 

0.32381767 

-1.531 

0 . 1261 

*T 

1 

0.461329 

0.20711066 

2 .227 

0 . 0261 

*  Indicator  variables 


PREDICTION  ERROR 


N  Mean  Std  Dev  Minimum  Maximum 


145  2.3344190  1.7337415  0.0025826  8.0839903 
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Regression  /  Prediction  Error  Results  (Non-rated  Operations) 


Source 
Model 
Error 
C  Total 


Analysis 

Sum  of 
DF  Squares 

12  6315.44543 

1606  17458.33592 

1618  23773.78135 


of  Variance 

Mean 

Square 

526.28712 

10.87069 


F  Value  Prob>F 
48.413  0.0001 


Root  MSE 
Dep  Mean 
C.  V. 


3 . 29707 
20.42557 
16.14189 


R-square 
Adj  R-sq 


0.2656 
0 .2602 


Parameter  Estimates 


Parameter 

Standard 

T  for  HO: 

Variable 

DF 

Estimate 

Error 

Parameter=0 

P  >  j  T  | 

INTERCEP 

1 

7 . 599636 

0.81314546 

9 . 346 

0 . 0001 

GPA 

1 

2.468166 

0.19809833 

12 . 459 

0 . 0001 

AFOQT  A 

1 

0.066545 

0.00464134 

14.338 

0 . 0001 

AFLYHRS 

1 

0.008501 

0.00308844 

2.753 

0 . 0060 

*T 

1 

1.102368 

0.24816557 

4 .442 

0.0001 

LORS  GEN 

1 

1.056374 

0.21208040 

4 . 981 

0 . 0001 

*SX 

1 

1.331728 

0.21666022 

6.147 

0.0001 

LORS  COL 

1 

0.664853 

0.18158280 

3 . 661 

0.0003 

* MARS TAT 

1 

0.506521 

0.19088469 

2 . 654 

0.0080 

*APR 

1 

-0.806690 

0.25299006 

-3 . 189 

0 . 0015 

WAIVS 

X 

-0.531360 

0.25470896 

-2 . 086 

0.0371 

EVAL1145 

1 

0.159308 

0.09912665 

1 . 607 

0. 1082 

*MIN0R 

1 

0.496442 

0.34035211 

1.459 

0 . 1449 

*  Indicator  variables 


PREDICITON  ERROR 


N 


Mean  Std  Dev  Minimum 


Maximum 


177 


2.7971218  1.9110768  0.0519215  10.1569195 
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Regression  /  Prediction  Error  Results  (Technical) 


Analysis  of  Variance 


Sum  of 

Mean 

Source 

DF 

Squares 

Square 

F  Value 

Model 

9 

2925.57384 

325.06376 

19.468 

Error 

559 

9334 . 03776 

16.69774 

C  Total 

568 

12259 . 61160 

Root 

MSE 

4 . 08629 

R-square 

0.2386 

Dep 

Mean 

21.57996 

Adj  R-sq 

0.2264 

C.V. 

18 .93556 

Parameter  Estimates 


Variable 

DF 

Parameter 

Estimate 

Standard 

Error 

T  for  HO: 
Parameter=0 

INTERCEP 

1 

6.614265 

1.36445403 

4 .848 

APRYRS 

1 

-0.164926 

0.06409645 

-2 . 573 

GPA 

1 

2 . 573260 

0.38991545 

6.600 

AFOQT  A 

1 

0.086444 

0.00948481 

9. 114 

*CALC 

1 

0.873485 

0 .48877385 

1 .787 

LORS  GEN 

1 

2 . 632858 

0.90477766 

2 .910 

*NOBACH 

1 

1.061780 

0 . 50853989 

2 . 088 

WAIVS 

1 

1.145752 

0.60917044 

1.881 

AFLYHRS 

1 

-0.025120 

0.00931418 

-2 . 697 

*PRIVLIC 

1 

4.418290 

1.89917770 

2.326 

*  Indicator  variables 


PREDICTION  ERROR 

N  Mean  Std  Dev  Minimum  Maximum 


65 


3.4361878  2.7108843  0.2359842  10.1759592 


Prob>F 
0 . 0001 


>  1  T  1 

i  1  I 

0 . 0001 
0.0103 
0.0001 
0.0001 
0 . 0745 
0.0038 
0.0373 
0 . 0605 
0.0072 
0.0204 
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Analysis  of  Variance 


Sum  of 

Mean 

Source 

DF 

Squares 

Square 

F  Value 

Prob>F 

Model 

14 

12464 . 56095 

890.32578 

83 . 103 

0 . 0001 

Error 

2514 

26933.93569 

10.71358 

C  Total 

2528 

39398 .49664 

Root 

MSE 

3 .27316 

R-square 

0. 3164 

Dep 

Mean 

20.92626 

Adj  R-sq 

0.3126 

C.V. 

15.64140 

Parameter  Estimates 


Parameter 

Standard 

T  for  HO: 

Variable 

DF 

Estimate 

Error 

Parameter=0 

P  >  ]  T  | 

INTERCEP 

1 

6.014285 

0.57160462 

10.522 

0.0001 

EVAL1145 

1 

0.112605 

0.03292491 

3 .420 

0 . 0006 

GPA 

1 

2.479181 

0.14817933 

16.731 

0.0001 

AFOQT  A 

1 

-0.053941 

0.03564603 

-1.513 

0.1303 

AFOQT  P 

1 

0.012978 

0.00371784 

3.491 

0 . 0005 

AFOQT  Q 

1 

0.063558 

0.01993085 

3 . 189 

0.0014 

AFOQT  V 

1 

0.075983 

0.02123752 

3 . 578 

0.0004 

*CALC 

1 

0.434497 

0.15753945 

2.758 

0 . 0059 

*SX 

1 

0.674930 

0.15736914 

4 . 289 

0. 0001 

*BACHPLUS 

1 

1.075768 

0.33453450 

3.216 

0.0013 

LORS  GEN 

1 

0.915786 

0.12905855 

7 . 096 

0 . 0001 

LORS  COL 

1 

0.358931 

0.09177405 

3 .911 

0 . 0001 

WAIVS 

1 

-0.619447 

0.19547363 

-3 . 169 

0. 0015 

*MINOR 

1 

0.448953 

0.24123369 

1 .861 

0.0629 

*AGEWAIV 

1 

-0.458792 

0.30838051 

-1 .488 

0 . 1369 

*  Indicator  variables 


PREDICTION  ERROR 

N  Mean  Std  Dev  Minimum  Maximum 

269  2.8484619  1.9582236  0.0146524  8.1976250 
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Appendix  I:  Discriminant  Analysis  Results 

(Pixot) 


GROUP 

Frequency 

Weight 

Proportion 

Prior 

Probability 

1 

685 

685.0000 

0.292985 

0.292985 

2 

1653 

1653 

0.707015 

0 .707015 

Simple 

Statistics 

Total-Sample 

Variable 

N 

Sum 

Mean 

Variance 

Std  Dev 

EVAL1145 

2338 

8532 

3 . 64927 

4 .85683 

2 . 20382 

GPA 

2338 

6809 

2.91247 

0. 18706 

0.43250 

AFOQT  N 

2338 

175903 

75.23653 

283 .22816 

16 . 82938 

AFOQT  P 

2338 

186253 

79.66339 

210.21399 

14 . 49876 

AFOQT  Q 

2338 

158795 

67.91916 

395.34520 

19 .88329 

AFLYHRS 

2338 

200233 

85.64286 

71518 

267 .42940 

GRADE 

2338 

615.00000 

0.26305 

1.12932 

1 . 06270 

GROUP  =  1 

Variable 

N 

Sum 

Mean 

Variance 

Std  Dev 

EVAL1145 

685 

2838 

4 . 14307 

3 . 52336 

1 . 87706 

GPA 

685 

2127 

3 . 10563 

0. 19510 

0 .44170 

AFOQT  N 

685 

56179 

82.01314 

208 .71766 

14 .44706 

AFOQT  P 

685 

58735 

85.74453 

131.89516 

11 . 48456 

AFOQT  Q 

685 

51723 

75.50803 

319 . 49007 

17 .87429 

AFLYHRS 

685 

91594 

133.71387 

129569 

359 .95629 

GRADE 

685 

224 . 00000 

0.32701 

1.42215 

1. 19254 

GROUP  =  2 

Variable 

N 

Sum 

Mean 

Variance 

Std  Dev 

EVAL114  5 

1653 

5694 

3 .44465 

5 .26888 

2 .29540 

GPA 

1653 

4682 

2 .83242 

0 . 16196 

0.40245 

AFOQT  N 

1653 

119724 

72 . 42831 

287.31765 

16.95045 

AFOQT  P 

1653 

127518 

77 . 14338 

221 . 08052 

14 . 86878 

AFOQT  Q 

1653 

107072 

64 . 77435 

393 .21600 

19 .82967 

AFLYHRS 

1653 

108639 

65.72232 

46171 

214 .87503 

GRADE 

1653 

391.00000 

0.23654 

1 . 00636 

1 . 00318 
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Main  Group 


Number  of 

Observations 

and  Percent  Classified 

into  GROUP 

From  GROUP 

1 

2 

Total 

1 

224 

461 

685 

32.70 

67 .30 

100 . 00 

2 

115 

1538 

1653 

6.96 

93 . 04 

100.00 

Total 

339 

1999 

2338 

Percent 

14.50 

85.50 

100.00 

Priors 

0.2930 

Error  Count 

0.7070 

Estimates  for  GROUP: 

1 

2 

Total 

Rate 

0.6730 

0 . 0696 

0.2464 

Priors 

0.2930 

0.7070 

Validation  Group 

Number  of 

Observations  and  Percent  Classified 

into  GROUP: 

From  GROUP 

1 

2 

Total 

1 

29 

63 

92 

31.52 

68 .48 

100 . 00 

2 

16 

170 

186 

8 . 60 

91.40 

100 . 00 

Total 

45 

233 

278 

Percent 

16.19 

83.81 

100 . 00 

Priors 

0.2930 

Error  Count 

0.7070 

Estimates  for  GROUP: 

1 

2 

Total 

Rate 

0.6848 

0 . 0860 

0.2614 

Priors 

0.2930 

0.7070 
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Discriminant  Analysis  Results  (Navigator) 


Prior 

GROUP  Frequency  Weight  Proportion  Probability 


1 

379 

379.0000 

0 .310911 

0 . 310911 

2 

840 

840.0000 

0.689089 

0.689089 

Simple 

Statistics 

Total-Sample 

Variable 

N 

Sum 

Mean 

Variance 

Std  Dev 

GPA 

1219 

3534 

2 . 89895 

0. 17684 

0.42052 

AFOQT  P 

1219 

89230 

73 . 19934 

277 .34529 

16.65369 

AFOQT  Q 

1219 

84034 

68 . 93683 

346.40898 

18 . 61207 

AFLYHRS 

1219 

28629 

23 . 48564 

10822 

104 . 02775 

EVAL1145 

1219 

5075 

4 . 16325 

3 . 39451 

1 . 84242 

AFOQT  V 

1219 

85150 

69.85234 

400.56274 

20 . 01406 

APRYRS 

1219 

339.00000 

0.27810 

1.27153 

1 . 127b2 

LORS  COL 

1219 

6.00000 

0.00492 

0 . 00819 

0.0 9048 

GROUP  =  1 

Variable 

N 

Sum 

Mean 

Variance 

Std  Dev 

GPA 

379 

1170 

3 . 08741 

0.16773 

0 .40954 

AFOQT  P 

379 

29957 

79 . 04222 

212 . 82361 

14 . 58848 

AFOQT  Q 

379 

28355 

74.81530 

272 . 99225 

16 . 52248 

AFLYHRS 

379 

14652 

38 . 65963 

15753 

125 . 50899 

EVAL1145 

379 

1685 

4 .44591 

2 .40646 

1 . 55128 

AFOQT  V 

379 

28237 

74 . 50396 

346.33530 

18 . 61009 

APRYRS 

379 

169. 00000 

0.44591 

2 . 03080 

1 . 42506 

LORS  COL 

379 

1.00000 

0.00264 

0 . 00264 

0 . 05137 

GROUP  =  2 


Variable 

N 

Sum 

Mean 

Variance 

Std  Dev 

GPA 

840 

2364 

2 .81392 

0. 15787 

0. 39733 

AFOQT  P 

840 

59273 

70.56310 

284 . 36550 

16.86314 

AFOQT  Q 

840 

55679 

66.28452 

357 . 24553 

18 .90094 

AFLYHRS 

840 

13977 

16.63929 

8462 

91 . 99054 

EVAL1145 

840 

3390 

4 .03571 

3.79133 

1 . 94713 

AFOQT  V 

840 

56913 

67 . 75357 

411.28723 

20 . 28022 

APRYRS 

840 

170.00000 

0.20238 

0 .91251 

0 .95525 

LORS  COL 

840 

5 . 00000 

0 . 00595 

0 .01069 

0 . 10340 
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Main  Group 


Number  of 

Observations  and 

Percent  Classified 

into  GROUP: 

>m  GROUP 

1 

2 

Total 

1 

193 

186 

379 

50.92 

49 . 08 

100.00 

2 

142 

698 

840 

16.90 

83 . 10 

100 . 00 

Total 

335 

884 

1219 

Percent 

27.48 

12. 52 

100.00 

Priors 

0.3109 

0.6891 

Rate 

Priors 


Error  Count  Estimates  for  GROUP: 

1  2  Total 
0.4908  0.1690  0.2691 
0.3109  0.6891 


Validation  Group 

Number  of  Observations  and  Percent  Classified  into  GROUP: 


>m  GROUP 

1 

2 

Total 

1 

21 

32 

53 

39 . 62 

60.38 

100 . 00 

2 

11 

81 

92 

11 . 96 

88 . 04 

100.00 

Total 

32 

113 

145 

Percent 

22 . 07 

77 .93 

100 . 00 

Priors 

0 .3109 

0 . 6891 

Error  Count  Estimates 

for  GROUP: 

1 

2 

Total 

Rate 

0.6038 

0 . 1196 

0 . 2701 

Priors 

0 .3109 

0.6891 
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Discriminant  Analysis  Results  (Non-rated  Operations) 


GROUP 

Frequency 

Weight 

Proportion 

Prior 

Probability 

1 

530 

530.0000 

0. 327363 

0.327363 

2 

1089 

1089 

0.672637 

0 . 672637 

Simple  Statistics 


Total-Sample 


Variable 

N 

Sum 

Mean 

Variance 

Std  Dev 

GPA 

1619 

4820 

2 . 97705 

0 . 19205 

0 .43824 

AFOQT  A 

1619 

110786 

68 .42866 

341.46014 

18 .47864 

GRADE 

1619 

1016 

0. 62755 

2 . 74438 

1 . 65662 

LORS  GEN 

1619 

185.00000 

0.11427 

0 . 17297 

0 . 41589 

AFLYHRS 

1619 

5276 

3 .25880 

725.43792 

26 . 93395 

GROUP  =  1 

Variable 

N 

Sum 

Mean 

Variance 

Std  Dev 

GPA 

530 

1670 

3.15127 

0.19640 

0.44317 

AFOQT  A 

530 

39208 

73.97736 

315.37945 

17 .75893 

GRADE 

530 

535.00000 

1.00943 

4 .31182 

2 . 07649 

LORS  GEN 

530 

108 . 00000 

0.20377 

0.31757 

0.56353 

AFLYHRS 

530 

2585 

4 . 87736 

1497 

38.68972 

GROUP  =  2 

Variable 

N 

Sum 

Mean 

Variance 

Std  Dev 

GPA 

1089 

3150 

2 . 89226 

0 . 16813 

0 .41004 

AFOQT  A 

1089 

71578 

65. 72819 

332.15767 

18 . 22519 

GRADE 

1089 

481.00000 

0 .44169 

1 . 87918 

1 . 37083 

LORS  GEN 

1089 

77 . 00000 

0 . 07071 

0 . 09702 

0 .31148 

AFLYHRS 

1089 

2691 

2 . 47107 

349 . 11520 

18 . 68462 
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Main  Group 


Number  of 

Observations  and  Percent 

Classified 

into  GROUP: 

From  GROUP 

1 

2 

Total 

1 

127 

403 

530 

23 . 96 

76.04 

100. 00 

2 

111 

978 

1089 

10.19 

89.81 

100.00 

Total 

238 

1381 

1619 

Percent 

14.70 

85.30 

100 . 00 

Priors 

0.3274 

Error  Count  Estimates 

0.6726 

for  GROUP: 

1 

2 

Total 

Rate 

0.7604 

0 . 1019 

0.3175 

Priors 

0. 3274 

0 . 6726 

.  idation  Group 

Number  of 

Observations  and  Percent 

Classified 

into  GROUP: 

From  GROUP 

1 

2 

Total 

1 

15 

41 

56 

26.79 

73.21 

100 . 00 

2 

14 

107 

121 

11.57 

88.43 

100 . 00 

Total 

29 

148 

177 

Percent 

16.38 

83 . 62 

100 . 00 

Priors 

0.3274 

Error  Count  Estimates 

0.6726 

for  GROUP: 

1 

2 

Total 

Rate 

0.7321 

0 . 1157 

0. 3175 

Priors 

0.3274 

0. 6726 
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Discriminant  Analysis  Results  (Technical) 


GROUP 

Frequency 

Weight 

Proportion 

Prior 

Probability 

1 

193 

193 . 0000 

0.339192 

0.339192 

2 

376 

376.0000 

0 . 660808 

0 . 660808 

Simple  Statistics 
Total-Sample 


Variable 

N 

Sum 

Mean 

Variance 

Std  Dev 

AFOQT  A 

569 

42273 

74.29350 

345.28167 

18 . 58176 

GPA 

569 

1722 

3 . 02652 

0 . 22206 

0.47123 

LORS  GEN 

569 

10.00000 

0.01757 

0 . 03842 

0 . 19602 

GROUP  =  1 


Variable 

N 

Sum 

Mean 

Variance 

Std 

Dev 

AFOQT  A 

193 

15938 

82 . 58031 

213 .94274 

14  . 

62678 

GPA 

193 

612 . 00300 

3  .  I"7 100 

0.23930 

0  . 

48918 

LORS  GEN 

193 

8 . 00000 

0.04145 

0.10244 

0. 

32006 

GROUP  =  2 


Variable 

N 

Sum 

Mean 

Variance 

Std  Dev 

AFOQT  A 

376 

26335 

70.03989 

359 . 96374 

18 .97271 

GPA 

376 

1110 

2 . 95235 

0 . 19757 

0 . 44449 

LORS  GEN 

376 

2 . 00000 

0 . 00532 

0 . 00530 

0.07284 
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Main  Group 


Numoer  of 

Observations 

and 

Percei.t  Classified 

into  GROUP: 

From  GROUP 

1 

2 

Total 

1 

8 

185 

193 

4 . 15 

95.85 

100 . 00 

2 

3 

373 

376 

0.80 

99 .20 

100 . 00 

Total 

11 

558 

569 

Percent 

1 .93 

98 . 07 

100 . 00 

Priors 

0.3392 

0. 5PJ8 

Error  Count 

Estimates  for  GROUP: 

1 

2 

Total 

Rate 

0 .9585 

0 . 0080 

0.3304 

Priors 

0 . 3392 

0 . 6608 

Validation  Group 

Number  of 

Observations 

and 

Percent  Classi f j ed 

into  GROUP: 

From  GROUP 

1 

2 

Total 

1 

0 

29 

29 

0.00 

100.00 

100 . 00 

2 

1 

35 

36 

2.78 

97 .22 

100 . 00 

Total 

1 

64 

65 

Percent 

1.54 

98 .46 

100 . 00 

Priors 

0. 3392 

0 . 6608 

Error  Count 

Estimates  for  GROUP: 

1 

2 

Total 

Rate 

1 . 0000 

0.0278 

0.3575 

Priors 

0.3392 

0.6608 
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Discriminant  Analysis  Results  CNon-technical ) 


Prior 

GROUP 

Frequency  Weight  Proportion  Probability 

1 

683  683. 

0000  0. 

270067 

0.270067 

2 

1846 

1846  0. 

729933 

0 .729933 

Simple  Statistics 

Total-Sampl 

e 

Variable 

N 

Sum 

Mean 

Variance 

Std  Dev 

AFOQT  A 

2529 

165212 

65.32701 

442 .85624 

21 . 04415 

GPA 

2529 

7774 

3 . 07410 

0.21681 

0.46563 

LORS  GEN 

2529 

471.00000 

0.18624 

0 .28057 

0.52969 

EVAL1145 

2529 

10007 

3 .95690 

4 . 00645 

2 . 00161 

LORS  COL 

2529 

866.00000 

0.34243 

0.62716 

0 . 79193 

AFOQT  P 

2529 

144099 

56.97865 

505.64432 

22 .48654 

WAIVS 

2529 

112 . 00000 

0.04429 

0.11275 

0.33579 

GROUP  =  1 

Variable 

N 

Sum 

Mean 

Variance 

Std  Dev 

AFOQT  A 

683 

52082 

76.25476 

271.33970 

16.47239 

GPA 

683 

2236 

3 .27343 

0.18784 

0.43340 

LORS  GEN 

683 

205.00000 

0.30015 

0.48309 

0.69505 

EVAL1145 

683 

3017 

4 .41728 

2 . 53090 

1.59088 

LORS  COL 

683 

264 . 00000 

0.38653 

0 .72134 

0 . 84932 

AFOQT  P 

683 

43962 

64 .36603 

440.92447 

20 . 99820 

WAIVS 

683 

23 . 00000 

0.03367 

0.08831 

0 . 29717 

GROUP  =  2 

Variable 

N 

Sum 

Mean 

Variance 

Std  Dev 

AFOQT  A 

1846 

113130 

61.28386 

445.93456 

21 . 11716 

GPA 

1846 

5539 

3 . 00035 

0.20748 

0.45550 

LORS  GEN 

1846 

266 . 00000 

0. 14410 

0. 19928 

0.44641 

EVAL1145 

1846 

6990 

3 . 78657 

4 .44656 

2 . 10869 

LORS  COL 

1846 

602 . 00000 

0 . 32611 

0.59170 

0 .76922 

AFOQT  P 

1846 

100137 

54 .24540 

502 . 16468 

22.40903 

WAIVS 

1846 

89 . 00000 

0.04821 

0. 12179 

0 . 34899 
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Main  Group 


Number  of 

Observations  and 

Percent  Classified 

into  GROUP: 

m  GROUP 

1 

2 

Total 

1 

284 

399 

683 

41.58 

58 .42 

ICO . 00 

2 

223 

1623 

1846 

12 . 08 

87 . 92 

100.00 

Total 

507 

2022 

2529 

Percent 

20.05 

79.95 

100 . 00 

Priors 

0.2701 

0.7299 

Rate 

Priors 


Error  Count  Estimates  for  GROUP: 


1 

0.5842 

0.2701 


2 

0. 1208 
0.7299 


Total 

0.2459 


Validation  Group 

Number  of  Observations  and  Percent  Classified  into  GROUP: 


>m  GROUP 

1 

2 

Total 

1 

26 

54 

80 

32 . 50 

67 . 50 

100 . 00 

2 

16 

173 

189 

8 . 47 

91 . 53 

100 . 00 

Total 

42 

227 

269 

Percent 

15.61 

84 . 39 

100.00 

Priors 

0.2701 

0.7299 

Error  Count  Estimates 

for  GROUP: 

1 

2 

Total 

Rate 

0.6750 

0 . 0847 

0. 2441 

Priors 

0.2701 

0 .7299 
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Appendix  J;  Board  Score  Cumulative  Frequency  Plot 


Plot  of  CUMFREQ*BDSCORE 
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Legend:  A  =  1  obs,  B  =  2  obs 
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Appendix  K:  SAS  Programs 


/ *  PREG . S AS  * / 

/*PILOT*/ 

/♦REGRESSION  ANALYSIS  FROM  STEPWISE 
DISCRIMINANT  ANALYSIS 
PREDICTED  VALUES*/ 

OPTIONS  LINESIZE=7 0  NOOVP; 

libname  sandi  ' gor91m: [sniemi . sas] ' ; 

DATA  rsm ; 

SET  sandi. thes; 

% INCLUDE  LASTBD ; 

IF  PROGRAM^ 1 P ' ; 

% INCLUDE  LOADVAR; 

IF  BDTOT>24  THEN  GR0UP=1;  ELSE  GROUP=2 ; 

% INCLUDE  KEEPVAR ; 

DATA  NEW; 

SET  sanJi.thes; 

% INCLUDE  LASTBD; 

IF  PROGRAM='P'; 

% INCLUDE  LOADVAR2; 

IF  BDTOT>24  THEN  GROUP=l ;  ELSE  GROUP=2; 

PREDBD=7 .869655+. 09 5546* APRYRS+. 17 389 1*EVAL1 14 5+2 .458751* 
GPA+ . 02  784 l*AFOQT_A+ . 04  8 13  5*AFOQT_P+ . 92  8  3  78  *PRIVLIC+ 

. 001146*AFLYHRS+ . 657326*CALC+1 . 4 19295*SX+1 .018999* 
BACHPLUS+ . 484627*T ; 

PERROR=ABS ( BDTOT-PREDBD)  ; 

IINCLUDE  KEEPVAR2 ; 

% INCLUDE  DISC; 

% INCLUDE  PDVAR; 

PROC  REG  DATA=rsm; 

MODEL  BDTOT  =  APRYRS 

EVAL1145  GPA  AFOQT_A  AFOQT_P 
PRIVLIC  AFLYHRS  CALC 
SX  BACHPLUS  T; 

% INCLUDE  APT; 

PROC  MEANS  DATA=NEW; 

VAR  PERROR; 

PROC  PLOT  DATA=NEW ; 

PLOT  BDTOT* PREDBD; 
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/*LASTBD . SAS*/ 

/*READS  IN  INFO  FROM  LAST  BOARD*/ 


IF  M4BDTOT=MISSING  THEN  M4BDTOT=0; 
IF  M3BDTOT=MISSING  THEN  M3BDTOT=0; 
IF  M2BDTOT=MISSING  THEN  M2BDTOT=0; 


BDTOT— Ml BDTOT ; 

BDSEL=M4SELECT ; 

PROGRAM=M4  PROG ; 

DEGLEV=M4 DEGLEV ; 

GPA=M4GPA; 

IF  M4BDTOT=0  THEN  DO; 

BDTOT=M3  BDTOT ; 

BDSEL— M3 SELECT ; 

PROGRAM=M3 PROG ; 

DEGLEV=M3 DEGLEV ; 

GPA=M3GPA ; 

END; 

IF  M4BDTOT=0  AND  M3BDTOT=0  THEN  DO; 

BDTOT=M2  BDTOT ; 

BDSEL=M2 SELECT; 

PROGRAM=M  2 PROG ; 

DEGLEV=M2  DEGLEV ; 

GPA=M2GPA ; 

END; 

IF  M4BDTOT=0  AND  M3BDTOT=0  AND  M2BDTOT=0  THEN  DO ; 
BDTOT=Ml BDTOT ; 

BDSEL=M1SELECT; 

PROGRAM=M 1 PROG ; 

DEGLEV=M1DEGLEV ; 

GPA=M1GPA; 

END; 


116 


/ *  LO ADVAR . S AS  * / 

/* LOADS  VARIABLES,  PERFORMS  CONVERSIONS*/ 

LASTSSN=SUBSTR ( SSAN ,9,1) ; 

IF  LASTSSN  NE  9; 

IF  APP_STAT='A»  THEN  PRIOR=l;  ELSE  PRIOR=0 ; 

IF  ALL9LST3= ' N 1  THEN  APR=1 ;  ELSE  APR=0; 

IF  LORS_COL=MISSING  THEN  LORS_COL-0; 

IF  LORS_GEN=MISSING  THEN  LORS_GEN=0; 

IF  LORS_TOT=MISSING  THEN  LORS_TOT=0; 

IF  APRYRS=MISSING  THEN  APRYRS-  ; 

NOBACH=0 ; 

BACH=0 ; 

BACHPLUS=0 ; 

MAST=0 ; 

IF  DEGLEV= ' J '  THEN  NOBACH=l ; 

IF  DEGLEV= ' N '  OR  DEGLEV= ' O '  OR  DEGLEV='P'  OR  DEGLEV= ' Q ' 

OR  DEGLEV= ' R '  THEN  BACH=1; 

IF  DEGLEV= ' O '  OR  DEGLEV='P’  OR  DEGLEV- ' Q '  OR  DEGLEV= ' R ' 

THEN  BACHPLUS=1 ; 

IF  DEGLEV= ' P '  OR  DEGLEV= ' Q '  OR  DEGLEV= ' R '  THEN  MAST=1 ; 

IF  RSOPPL= ' 1 1  THEN  PRIVLIC=1;  ELSE  PRIVLIC=0; 

IF  AFLYHRS=MISSING  THEN  AFLYHRS=0  ,* 

IF  CALCULUS= ' 1 1  THEN  CALC=1 ;  ELSE  CALC=0 ; 

IF  DISENROL= ' Y '  THEN  DISENRL=1 ;  ELSE  DISENRL-0 ; 

IF  GRADE=MISSING  THEN  GRADE=0 ; 

IF  WAIVER1= ' 1 '  OR  WAIVER1= ' 2 '  THEN  AGEWAIV=1 ;  ELSE  AGEWAIV=0 ; 

IF  WAIVER2= ' 0 '  THEN  WAIVS=0; 

IF  WAIVER2= ' 1 '  THEN  WAIVS=1; 

IF  WAIVER2= 1 2  *  THEN  WAIVS=2 ; 

IF  WAIVER2= ' 3 '  THEN  WAIVS=3 ; 

IF  WAIVER2= 1 4 '  THEN  WAIVS=4 ; 

IF  WAIVER2= 1 5 '  THEN  WAIVS=5 ; 

IF  WAIVER2= ' 6 '  THEN  WAIVS=6; 

IF  WAIVER2=MISSING  THEN  WAIVS=0 ; 

IF  MARITAL='M'  THEN  MARSTAT=1 ;  ELSE  MARSTAT=0; 

IF  RACE= ' N 1  OR  RACE='X'  THEN  MINOR=l;  ELSE  MINOR=0 ; 

IF  SEX= ' F '  THEN  SX=1;  ELSE  SX=0 ; 

GPA=GPA/100 ; 

% INCLUDE  MAJOR; 
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/*MAJOR. SAS*/ 

/*ASSIGNS  VALUE  FOR  TECHNCIAL  MAJOR  VARIABLE*/ 


T=0 ; 


IF 

DEG 

TYPE= ' OCCB 1 

THEN 

T=1 

IF 

DEG 

’tYPE='OCYY' 

THEN 

T=1 

IF 

DEG~ 

_TYPE='OYBY' 

THEN 

T=1 

IF 

DEG 

-TYPE= • OYRY • 

THEN 

T=1 

IF 

deg' 

~TYPE=  1  4AYY  ’ 

THEN 

T=1 

IF 

deg’ 

TYPE=  •  4BYY  1 

THEN 

T=1 

IF 

DEG 

TYPE= 1 4CYY 1 

THEN 

T=1 

IF 

deg' 

~TYPE= '  4DYY ' 

THEN 

T=1 

IF 

DEG 

TYPE= 1  4EYY ' 

THEN 

T=1 

IF 

DEG 

TYPE= ' 4FYY ' 

THEN 

T=1 

IF 

deg’ 

~TYPE= ' 4GYY ' 

THEN 

T=1 

IF 

DEG 

~TYPE= '  4HBY ' 

THEN 

T=1 

IF 

deg' 

~TYPE= '  4HYY  1 

THEN 

T=1 

IF 

deg' 

~TYPE=  1  4IYY ' 

THEN 

T=1 

IF 

deg' 

~TYPE=  '  4  JYY  ' 

THEN 

T=1 

IF 

DEG 

~TYPE= 1 4LYY 1 

THEN 

T=1 

IF 

DEG 

~TYPE= '  4MYY  1 

THEN 

T=1 

IF 

DEG 

~TYPE=  *  4NYY ' 

THEN 

T=1 

IF 

DEG 

TYPE= ' 40BY ' 

THEN 

T=1 

IF 

DEG 

~TYPE= '  40YY  1 

THEN 

T=1 

IF 

DEG 

~TYPE=  1  4QYY  ' 

THEN 

T=1 

IF 

DEG 

~TYPE=  1  4TYY ' 

THEN 

T=1 

IF 

DEG 

~TYPE= '  4UYY ' 

THEN 

T=1 

IF 

DEG 

TYPE= ' 4 VAX ' 

THEN 

T=1 

IF 

DEG 

’TYPE= '  4VKY ' 

THEN 

T=1 

IF 

DEG 

TYPE= ' 4 YYY 1 

THEN 

T=1 

IF 

deg' 

"TYPE= '  6BYY  ' 

THEN 

T=1 

IF 

DEG 

TYPE= 1 6YYY 1 

THEN 

T=1 

IF 

DEG 

’TYPE= '  8HYY  ' 

THEN 

T=1 

IF 

deg' 

TYPE= ' 8CYY 1 

THEN 

T=1 

IF 

deg" 

_TYPE= '  OCYY ' 

THEN 

T=1 

IF 

DEG 

’TYPE='OYBY' 

THEN 

T=1 
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/*KEEPVAR . SAS*/ 

/♦SPECIFIES  VARIABLES  TO  KEEP  FOR  ANALYSIS*/ 

KEEP  PRIOR  APR  LORS_COL  LORS_GEN  LORS_TOT  APRYRS  EVAL3145 
GPA  AFOQT_A  AFOQT_N  AFOQT_P  AFOQT_Q  AFOQT_V  PRIVLIC 
AFLYHRS  CALC  DISENRL  GRADE  AGEWAIV  WAIVS  MARSTAT  MINOR 
SX  NOBACH  BACH  BACHPLUS  BDTOT  PROGRAM  T  LASTSSN  GROUP; 


/♦KEEPVAR2 . SAS*/ 

/♦SPECIFIES  VARIABLES  TO  KEEP  FOR  ANALYSIS  OF  TEST  GROUP*/ 

KEEP  PRIOR  APR  LORS_COL  LORS_GEN  LORS_TOT  APRYRS  EVAL1145 
GPA  AFOQT__A  AFOQT_N  AFOQT_P  AFOQT_Q  AFOQT_V  PRIVLIC 
AFLYHRS  CALC  DISENRL  GRADE  AGEWAIV  WAIVS  MARSTAT  MINOR 
SX  NOBACH  BACH  BACHPLUS  BDTOT  PROGRAM  T  LASTSSN 
PREDBD  PERROR  GROUP; 
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/ *  L0ADVAR2 . S AS  */ 

/*LOAD  VARIABLES  FOR  TEST  GROUP*/ 

LASTSSN=SUBSTR ( SSAN ,9,1) ; 

IF  LASTS SN  EQ  9; 

IF  APP_STAT= 1 A 1  THEN  PRIOR=l;  ELSE  PRIOR=0 ; 

IF  ALL9LST3= 1 N 1  THEN  APR=1;  ELSE  APR=0 ; 

IF  LORS_COL=MISSING  THEN  LORS_COL=0 ; 

IF  LORS_GEN=MISSING  THEN  LORS_GEN=0; 

IF  LORS_TOT=MI S S I NG  THEN  LORS_TOT=0? 

IF  APRYRS=MISSING  THEN  APRYRS=0; 

NOBACH=0 ; 

BACH=0 ; 

BACHPLUS=0 ; 

MAST=0 ; 

IF  DEGLEV='J'  THEN  NOBACH=l; 

IF  DEGLEV= ' N '  OR  DEGLEV= ' O '  OR  DEGLEV= ' P '  OR  DEGLEV= 1 Q ' 

OR  DEGLEV= ' R 1  THEN  BACH=1; 

IF  DEGLEV= ' O '  OR  DEGLEV= ' P '  OR  DEGLEV= ' Q '  OR  DEGLEV= 1 R 1 
THEN  BACHPLUS=1; 

IF  DEGLEV= ' P '  OR  DEGLEV= ' Q '  OR  DEGLEV= 1 R '  THEN  MAST=1 ; 

IF  RSOPPL= 1 1 '  THEN  PRIVLIC=1;  ELSE  PRIVLIC-0; 

IF  AFLYHRS=MISSING  THEN  AFLYHRS=0 ; 

IF  CALCULUS='l'  THEN  CALC=1 ;  ELSE  CALC=0 ; 

IF  DISENROL='Y'  THEN  DISENRL=1 ;  ELSE  DISENRL=0 ; 

IF  GRADE=MISSING  THEN  GRADE=0 ; 

IF  WAIVERl='l'  OR  WAIVER1= ' 2 '  THEN  AGEWAIV=1;  ELSE  AGEWAIV=0 ; 

IF  WAIVER2= ' 0 1  THEN  WAIVS=0 ; 

IF  WAIVER2= ' 1 '  THEN  WAIVS=1; 

IF  WAIVER2= ' 2 '  THEN  WAIVS=2 ; 

IF  WAIVER2= 1 3 '  THEN  WAIVS=3 ; 

IF  WAIVER2= 1 4 1  THEN  WAIVS=4 ; 

IF  WAIVER2= 1 5 1  THEN  WAIVS=5 ; 

IF  WAIVER2='6'  THEN  WAIVS=6; 

IF  WAIVER2=MISSING  THEN  WAIVS=0; 

IF  MARITAL='M'  THEN  MARSTAT=1 ;  ELSE  MARSTAT=0 ; 

IF  RACE= ' N '  OR  RACE= ' X '  THEN  MINOR=l;  ELSE  MINOR=0; 

IF  SEX= ' F '  THEN  SX=1;  ELSE  SX=0; 

G  PA=G  PA/ 100; 

% INCLUDE  MAJOR; 
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/*DISC . SAS*/ 

/* DISCRIMINANT  ANALYSIS*/ 

PROC  FREQ  DATA=rsm; 

TABLES  GROUP; 

PROC  DISCRIM  DATA=rsm  SIMPLE  POOL=TEST  WCORR  TESTDATA=NEW ; 
CLASS  GROUP; 

PRIORS  PROPORTIONAL; 

/ *  PROC  STEPDISC  SIMPLE  DATA=rsm; 

CLASS  GROUP;*/ 


/ *  PDVAR . SAS  * / 

VAR  EVAL1145  GPA  AFOQT  N  AFOQT_P  AFOQT_Q  AFLYHRS  GRADE; 
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/♦APT . SAS*/ 

/♦RESIDUAL  PLOTS,  K-S  TEST,  Q-Q  PLOT*/ 

output  out=aptness  stdp=stderrm  195m=195bm  u95m=u95bm 
stdi=stderrp  I95=l95bp  u95=u95bp 
p=yhat  r=yresid  h=hatmatd; 

proc  plot  data=aptness ; 

plot  yresid*yhat  /  vref=0; 

proc  univariate  data=aptness  normal  noprint; 
var  yresid; 

output  out=normck  n=samsize  norma l=normtspv ; 

titlel  ' =============================================== 1 

title2  '  APTNESS  CHECK  FOR  NORMALITY  ' ; 

title3  *  WilkShapiro  if  N<51  else  Kolomogorov-Smirnov  ' 

title4  ' =============================================== ' 

proc  print  data=normck ; 
proc  rank  data=aptness  normal=vw; 
var  yresid; 
ranks  resrank; 
proc  plot; 

plot  resrank*yresid; 
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/ *  PI LOT . S AS  * / 


/♦PILOT*/ 

/♦PERFORMS  STEPWISE  REGRESSION 
GPA  ANALYSIS*/ 

/*2338  OBSERVATIONS  27  VARIABLES*/ 

/♦DEPENDENT  VARIABLE  BDTOT*/ 

OPTIONS  LINESIZE=70  NOOVP; 

libname  sandi  ' gor91m: [sniemi . sas] ' ; 

DATA  rsm; 

SET  sandi. thes; 

% INCLUDE  LASTBD; 

IF  PROGRAM= '  P '  ; 

% INCLUDE  LOADVAR; 
group=l ; 

% INCLUDE  KEEPVAR; 

/*PROC  FREQ; 

TABLES  BDTOT*/; 

PROC  SORT; 

BY  T; 

PROC  MEANS; 

BY  T; 

VAR  GPA; 

PROC  FREQ; 

TABLES  LASTSSN; 

PROC  STEPWISE  DATA=rsm ; 

MODEL  BDTOT  =  PRIOR  APR  LORS_COL  LORS__GEN  LORS_TOT  APRYRS 
EVAL1145  GPA  AFOQT_A  AFOQT_N  AFOQT_P  AFOQT_Q  AFOQT_V 
PRIVLIC  AFLYHRS  CALC  DISENRL  GRADE  AGEWAIV  WAIVS 
MARSTAT  MINOR  SX  NOBACH  BACH  BACHPLUS  T; 
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/*SA . SAS*/ 


/* CALCULATES  MEAN  FOR  LAST  BOARD  AND 

MEAN  FOR  FIRST,  SECOND,  THIRD,  AND  FOURTH  BOARDS*/ 

OPTIONS  LINESIZE=7 0  NOOVP; 

libname  sandi  'gor91m: [sniemi . sas] ' ; 

DATA  rsm ; 

SET  sandi. thes; 

% INCLUDE  LASTBD; 

%INCLUDE  LOADVAR3; 
gi.  oup=l ; 

% INCLUDE  KEEPVAR; 

DATA  ALLREC; 

SET  sandi. thes; 

%INCLUDE  LOADVAR3  ? 

KEEP  M1BDTOT  M1BDNUM  M2BDTOT  M2BDNUM  M3BDTOT  M3BDNUM 
M4BDTOT  M4BDNUM; 

PROC  MEANS  DATA=rsm; 

VAR  BDTOT; 

PROC  MEANS  DATA-ALLREC; 

VAR  Ml  BDTOT  1^2  BDTOT  M3  BDTOT  M4  BDTOT; 
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/ *  LOADVAR3 . S AS  * / 


/♦INCLUDES  ALL  RECORDS — ALL  SSANs  INCLUDED*/ 

LASTSSN=0 ; 

IF  APP_STAT- ' .1 '  THEN  PRIOR=l;  ELSE  PRIOR=0 ; 

IF  ALL9LST3= ' N '  THEN  APR=I ;  ELSE  APR=0; 

IF  LORS_COL=MISSING  THEN  LORS  COL=0; 

IF  LOK."_GEN=MISSING  THEN  L0P.3  GEN=0 ;  ) 

IF  LORS_TOT=MISSING  THEN  LORS~~rOT=0; 

IF  APx\'/RS=MISSING  THEN  APRYRS=0 ; 

NOBACH=0 ; 

BACH^O : 

BACHPLUS=0 ; 

MAST=0 ; 

IF  DEGLEV~ 1 J '  THEN  NOBACH=l , 

IF  DEGLEV=  '  ?T '  OR  DEGLEV=  '  0  '  OR  DEGLEV=  '  P  '  OR  DEG^EV^  '  Q  1 
OR  DEGLEV= 1 R '  THEN  BACH=i; 

IF  DEGLEV= 1 O '  OR  JEGLEV= ' P '  OR  DEGLEV='Q'  OR  DEGLEV= ' R ' 

THEN  BACHPLUS=l; 

IF  DEGLEV= 1 P '  OR  DEGLEV= ' Q '  OR  DEGLEV= ' R '  THEN  MAST=1; 

IF  RSOPPL= ' 1 '  THEN  PRIVLIC=1;  ELSE  PRIVLIC=0; 

IF  AFLYHRS=MISSING  THEN  AFLYHRS=0 ; 

IF  CALCULUS= ' 1 1  THEN  CALC=1 ;  ELSE  CALC=0; 

IF  DISENROL= ' Y '  THEN  DISENRL=1 ;  ELSE  DISENRL=0 ; 

IF  GRADE^MISSING  THEN  GRADE=0 ; 

IF  WAIVERl='l'  OR  WAIVER1= '  2  '  THEN  AGEWAIV=-j  :  ELSE  AGEWAIV=0  ; 

IF  WAIVER2= ' 0 '  THEN  WAIVS=0; 

IF  WAIVER2= ' 1 '  THEN  WAIVS=1; 

IF  WAIVER2= ' 2 1  THEN  WAIVS=2 ; 

IF  WAIVER2= ' 3 '  THEN  WAIVS=3 ; 

IF  WAIVER2= ' 4 '  THEN  WAIVS=4 ; 

IF  WAIVER2= ' 5 1  THEN  WAIVS=5 ; 

IF  WAIVER2= ' 6 '  THEN  WAIVS=6 ; 

IF  WAIVER2=MISSING  THEN  WAIVS=0 ; 

IF  MARITAL= ' M 1  THEN  MARS T AT =1 ;  ELSE  MARS TAT=0 ; 

IF  RACE= ' N '  OR  RACE= ' X '  THEN  MINOR=l ;  ELSE  MINOR=0 ; 

IF  SEX= ' F 1  THEN  SX=1;  ELSE  SX=0 ; 

GPA=GPA/100 ; 

% INCLUDE  MAJOR; 
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/♦ALL. SAS*/ 

/♦CALCULATES  MEAN  BOARD  SCORES  FOR  EACH  INDIVIDUAL  BOARD*/ 

OPTIONS  LINESIZE=70  NOOVP; 

libname  sandi  ' gor91m; [sniemi. sas] ' ; 

DATA  ALLREC; 

SET  sandi. thes; 

IF  M1BDNUM=8905  THEN  BDTOT=MlBDTOT ; 

ELSE  IF  M2 BDNUM=8 905  THEN  BDTOT=M2 BDTOT ; 

ELSE  IF  M3BDNUM=8905  THEN  BDTOT=M3 BDTOT ; 

ELSE  IF  M4 BDNUM=8 9  05  THEN  BDTOT=M4 BDTOT ; 

ELSE  BDTOT=MISSING ; 

KEEP  M1BDTOT  M1BDNUM  M2 BDTOT  M2BDNUM  M3 BDTOT  M3BDNUM 
M4 BDTOT  M4BDNUM  BDTOT; 

PROC  MEANS; 

VAR  BDTOT; 
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/ *TBDFREQ . S AS  */ 

/* CREATES  BOARD  SCORE  FREQUENCY  GRAPHS*/ 
OPTIONS  LINESIZE=70; 

libname  sandi  'gor91m: [sniemi . sas] ' ; 

DATA  BDS ; 

INPUT  BDSCORE  FREQ  PERCENT  CUMFREQ  CUMPERC; 
CARDS ; 


7.5 

1 

0.0 

1 

0.0 

8 

3 

0.0 

4 

0.0 

8.5 

2 

0.0 

6 

0. 1 

9 

4 

0.0 

10 

0.1 

9.5 

1 

0.0 

11 

0. 1 

10 

2 

0.0 

13 

0 . 1 

10.5 

8 

0.1 

21 

0.2 

11 

12 

0.1 

33 

0 . 4 

11.5 

10 

0.1 

43 

0 . 5 

12 

16 

0.2 

59 

0. 6 

12.5 

31 

0.3 

90 

1.0 

13 

45 

0.5 

135 

1.5 

13 . 5 

53 

0.6 

188 

2 . 0 

14 

81 

0.9 

269 

2 . 9 

14.5 

83 

0.9 

352 

3 . 8 

15 

132 

1.4 

484 

5 . 3 

15.5 

158 

1.7 

642 

7 . 0 

16 

410 

4 . 4 

1052 

11.4 

17 

506 

5.5 

1558 

16.9 

18 

643 

7.0 

2201 

23.9 

19 

690 

7.5 

2891 

31.4 

20 

871 

9.5 

3762 

40.8 

21 

763 

8.3 

4525 

49.1 

22 

825 

9.0 

5350 

58 . 1 

23 

950 

10.3 

6300 

68 . 4 

24 

896 

9.7 

7196 

78.1 

25 

757 

8 . 2 

7953 

86. 3 

26 

569 

6.2 

8522 

92 . 5 

27 

307 

3 . 3 

8829 

95.8 

28 

118 

1.3 

8947 

97 . 1 

29 

30 

0.3 

8977 

97 . 4 

30 

238 

2 . 6 

9215 

100.0 

f 

PROC  PLOT  DATA=BDS  ? 

PLOT  FREQ* BDSCORE ; 
PLOT  CUMFREQ*BDSCORE; 
PLOT  PERCENT*BDSCORE; 
PLOT  CUMPERC*BDSCORE; 
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/ *LOGTREG . SAS  */ 

/* REGRESS ION  FROM  STEPWISE 
PREDICTED  VALUES*/ 

OPTIONS  LINESIZE=7 G  NOOVP; 

libnanc  sar.di  'c;er91in:  [sniei:.i.  sas]  '  ; 

DATA  rsm; 

SET  sandi.thes; 

% INCLUDE  LASTBD; 

IF  PROGRAM= 1 T 1 ; 

% INCLUDE  LOADVAR; 

IF  BDTOT>23  THEN  GROUP=l ;  ELSE  GROUP=2 ; 
LNBDTOT=LOG ( 3  O-BDTOT)  ; 

% INCLUDE  KEEPVARL; 

DATA  NEW; 

SET  sandi.thes; 

% INCLUDE  LASTBD; 

IF  PROGRAM= ' T ' ; 

% INCLUDE  LOADVAR2 ; 

IF  BDTOT>23  THEN  GROUP=l ;  ELSE  GROUP=2 ; 

PREDBD=3 .83426-. 322987*GPA- . 0104*AFOQT_A+ . 001714* 
AFLYHRS- . 4 12 147*PRIVLIC+ . 0 1612 6*EVAL1 145- 
. 107949*SX ; 

LNBDTOT=LOG( 3 O-BDTOT) ; 

PERROR=ABS (LNBDTOT-PREDBD) ; 

% INCLUDE  KEEPV2L; 

/*%INCLUDE  DISC; 

% INCLUDE  TDVAR; */ 

PROC  REG  DATA=rsm; 

MODEL  LNBDTOT  =  GPA  AFOQT_A 

AFLYHRS  PRIVLIC  EVAL1145  SX; 

% INCLUDE  APT; 

PROC  MEANS  DATA=NEW ; 

VAR  PERROR; 

PROC  PLOT  DATA=NEW; 

PLOT  LNBDTOT*PREDBD; 
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